Smart Data Access and Integration with Hadoop

Last updated on Sep 06 2022
Prabhas Ramanathan

Table of Contents

Smart Data Access and Integration with Hadoop

In SAP HANA system, you can use Smart Data Access (SDA) option to replicate data to HANA database from other data sources where you create virtual tables, which are linked to tables in the remote system. You can perform read/write operations on these virtual tables – SELECT, Insert, and Update.

Different types of remote systems can be used under Smart Data Access −

  • SAP HANA
  • Sybase
  • Teradata
  • Apache Hadoop
  • Oracle

All the above remote data sources are supported under HANA SPS07 or higher. Older version of SAP HANA supports only – Sybase, Apache Hadoop, and Teradata.

New Remote System Connection

To create a new remote connection, navigate to Data Provisioning tab → New Remote Sources.

sap 45

Enter Source name and select Adapter from the dropdown list. On the right hand side, you have option to Test the Connection. You can also run to create the data source.

sap 46

Once you set up the connection, it can be used to perform read/write functions in remote system and to join the tables for data provisioning.

SAP HANA Admin – Integration with Hadoop

In SAP HANA system, you can also integrate SAP HANA computing power with Hadoop to process huge amount of data at faster speed. Hadoop system is used for storing huge amount of unstructured data and HANA provides high speed data analysis.

Following scenarios can be used to connect SAP HANA system to Hadoop −

  • Hive ODBC Driver
  • Smart Data Integration
  • HANA Spark Controller

To use Smart Data Access to connect to Hadoop system in HANA Studio, select Adapter Name: Hadoop

In Connection Properties, enter the URL and Credentials.

sap 47

You can also use the following SQL statement to create a remote connection to connect to Hadoop system. We have selected Authentication type as Password here −

CREATE REMOTE SOURCE RC_Hadoop
ADAPTER "hadoop"
CONFIGURATION 'webhdfs_url = http://
<full_qualified_domain_name>
:
50070;webhcat_url = http://
<full_qualified_domain_name>
:50111'
WITH CREDENTIAL TYPE 'PASSWORD'
USING 'user = username;password = pwd';

Enter the above SQL statement in HANA Studio SQL editor and click the Execute button.

sap 48

This way you can integrate your SAP HANA system with Hadoop using Smart data integration in HANA Studio.

SAP HANA Admin – Key Commands

Display the general information about HANA database and has to be executed in the command line

hdbsql -n localhost -i 1 -u username -p Password \s

This command will display the details of HANA database such as the host name, database, user, Kernel version, SQLDBC version, etc.

View the concurrent database login to HANA database

hdbsql -n localhost -i 1 -u username -p Password

“SELECT CNO,TITLE,FIRSTNAME,NAME,ZIP FROM Database_Name”

The above command displays the following result about concurrent sessions −

CNO | TITLE | FIRSTNAME | NAME | ZIP

Start and stop HANA database from HDB

To start and stop HANA database using HDB, you have to login to HANA system host as <sid>adm and run the following command −

/usr/sap/<SID>/HDB<instance number>/HDB start
/usr/sap/<SID>/HDB<instance number>/HDB stop

SAP HANA Admin – Job Responsibilities

Following are certain experiences and capabilities required to handle the job responsibility of HANA Admin.

  • Integration of SAP HANA into different remote systems. Exposure to different remote access options in HANA system.
  • Experience in monitoring, tuning, and troubleshooting of SAP HANA systems.
  • HANA system administration using SAP HANA Cockpit and HANA Studio.
  • Experience in managing users and roles in SAP HANA system.
  • Implementing SAP HANA Table management techniques – data compression, table partition, compression techniques, and load/unload table into memory.
  • HANA Installation, Data Provisioning, Admin, Modelling.
  • SAP BusinessObjects and HANA integration, Design document, RFPs, and estimation plans.
  • Experience with high availability and backup mechanism.
  • Implementing SAP HANA Security mechanism, HANA XS Application service, and monitoring of HANA system.

So, this brings us to the end of blog. This Tecklearn ‘Smart Data Access and Integration with Hadoop’ blog helps you with commonly asked questions if you are looking out for a job in SAP Hana Administration and SAP Domain. If you wish to learn SAP Hana Administration and build a career in SAP domain, then check out our interactive, SAP HANA Administration Training, that comes with 24*7 support to guide you throughout your learning period. Please find the link for course details:

https://www.tecklearn.com/course/sap-hana-administraion/

 SAP HANA Administration Training

About the Course

SAP HANA Administration training will help you learn SAP HANA administration tools, security and user management, system management and availability, data provisioning and integration with non-SAP systems and more. You will deploy SAP HANA Studio, automate through OS scripts, command line admin tools through hands-on projects and case studies. This course is designed to clear the HA200 SAP HANA Operations and Administration Certification conducted by SAP and helps you get the best jobs in top MNCs.

Why Should you take SAP HANA Administration Training?

  • The average salary for SAP HANA Database Administrator ranges from approximately $65,843 yearly for Administrator to $143,051 yearly for Enterprise Architect. – Indeed.com
  • SAP HANA is one of the top tools for working with real-time data due to the transformational nature of this tool. The role of an SAP HANA Administration and Operations personnel is critical of the success of SAP HANA deployment in any industrial set-up.
  • Worldwide Business Intelligence and Analytics Market to grow to $22.8 billion in next 2 years – Gartner.

What you will Learn in this Course?

Overview of SAP HANA

  • Overview of SAP HANA
  • Features and Benefits of SAP HANA
  • SAP HANA Components
  • Concept of SAP HANA guides
  • Scenarios in SAP HANA Administration

Architecture of SAP HANA

  • What is SAP HANA persistence?
  • Concept of Sizing in SAP HANA
  • Process of achieving scale out in SAP HANA
  • How SAP HANA achieves in-memory computation
  • Concept of columnar database
  • How SAP HANA is so fast with comparison to other tools

SAP HANA installation

Overview of SAP HANA tools

  • SAPA HANA Studio for Administration activities in SAP HANA
  • Accessing local and remote HANA systems using Client Tool
  • Monitor, Control, Configure and Administer the SAP HANA database using DBA Cockpit
  • Using HANA Studio Information modelling and data provisioning in HANA database
  • SAP HANA Transport

SAP HANA Operations

  • Privileges in HANA
  • Configure Password Policy and create user in SAP HANA
  • Auditing in SAP HANA

SAP HANA Smart Data Access

Data Provisioning in SAP HANA

  • Leveraging SAP HANA technology and integration architecture for enriching, cleansing and transforming data from disparate sources
  • Data replication with the SAP Landscape Transformation (SLT)
  • Implementing SLT Configuration with SUSPEND LOAD

SAP HANA Operations

  • Create Repository and Job Server
  • SAP GRC Architecture

Administration Operations in HANA Studio

  • Updating HANA database using lifecycle management
  • Security in SAP HANA
  • Sessions and Transactions in SAP HANA
  • Configure System Replication using HANA Cockpit

Migration to SAP HANA using DMO

Performance Monitoring and Analysis in SAP HANA

Got a question for us? Please mention it in the comments section and we will get back to you.

 

 

0 responses on "Smart Data Access and Integration with Hadoop"

Leave a Message

Your email address will not be published. Required fields are marked *