What is SAS Data Loader for Hadoop?
SAS
Data Loader for Hadoop is a software offering that makes it easier to move,
cleanse, and analyze data in Hadoop. It consists of a web application, elements of
the SAS 9.4
Intelligence Platform, and SAS software
that is installed
on the Hadoop cluster.
The SAS Data Loader for
Hadoopweb
application provides an interactive interface that guides you through the process
of creating
directives. You then run the directives on a SAS Workspace Server. The SAS Workspace
Server
executes generated code, sends code to Hadoop, and receives responses from Hadoop.
During
execution, directives provide access to generated code, log information, error messages,
and
results as they become available. You can save directives, update them, and execute
them as
needed.
SAS Data Loader for
Hadoop
System Diagram
Multiple users can access the
SAS Data Loader for
Hadoop
web application. The web application uses the SAS Web Infrastructure Platform to connect
to SAS
servers, to a Hadoop cluster, and to network database management servers. The SAS
Metadata
Server manages access to data sources and software capabilities for individuals and
groups. SAS
Management Console provides an administrative interface that configures the web application
and
manages SAS servers.
SAS software is also deployed to each node in the
Hadoop cluster. SAS software on the cluster includes the following components:
-
SAS Quality Knowledge Base, which supports data cleansing capabilities in Hadoop
-
SAS Embedded Process software, which runs SAS programs in Hadoop
-
SAS Data Quality Accelerator, which runs data quality capabilities in Hadoop
-
SAS Data Loader for Hadoop Spark2 Engine, which executes data integration and data quality tasks in Apache Spark2
To view a presentation that demonstrates the
capabilities of SAS Data Loader for Hadoop, see the SAS® Data Loader for Hadoop Demo.
Last updated: January 31, 2023