Data Engineer

AI-Bigdata Analytics Architecture

QP Code Q8106 NSQF Level 7

Brief Job Description

Individuals at this job are responsible for working on different aspects of data architecture. S/he will be responsible for developing data integrations.

Personal Attributes

A data engineer needs to be well organized and have good attention to detail and problem solving abilities.

Role Map

Technology AI-Bigdata Analytics

Job Category Architecture

Job Track Data Architecture

Roles

Data Engineer

NSQF Level: 7

Technical Competencies

Key job task/function that an individual has to perform as a part of the job. These are also known as National Occupational Standards (NOS).

6 6 Compulsory

Develop data integrations as per specifications

This unit is about developing integrations for ensuring data availability for analytical or operational uses

Compulsory NOS Code SSC/N8112 NSQF Level 7

Explore

Manage your work to meet requirements

This unit is about planning and organizing your work in order to complete it to the required standards on time.

Compulsory NOS Code SSC/N9001 NSQF Level 4

Explore

Work effectively with colleagues

This unit is about working effectively with colleagues, either in your own work group or in other work groups within your organization.

Compulsory NOS Code SSC/N9002 NSQF Level 4

Explore

Provide information in standard formats

This unit is about providing specified data/information related to your work in templates or other standard formats.

Compulsory NOS Code SSC/N9004 NSQF Level 4

Explore

Build and maintain relationships at the workplace

This unit is about building and maintaining constructive relationships at the workplace

Compulsory NOS Code SSC/N9006 NSQF Level 6

Explore

Maintain an inclusive, environmentally sustainable workplace

Compulsory NOS Code SSC/N9014 NSQF Level 5

Explore

View 4 more

Supplementary Topics

Advanced topics that will help you excel in this role

Database Management Concepts Big data modeling and management systems

Popular Tools Used by Data Engineer

Database Management System Cassandra MongoDB Oracle PL/SQL Teradata NoSQL Amazon DynamoDB Apache Hive MySQL Oracle JDBC Teradata Active EDW Blackboard IBM DB2

DBaaS AWS Hortonworks Cloudera Microsoft Azure

ETL Software Apache Spark Databricks Amazon RedShift CA Erwin Data Modeler Oracle Warehouse Builder SAS Data Integration Server Pentaho Kettle Apatar