Big Data Engineer

Bangalore Technology
apply now
Big Data Engineer Bangalore Technology apply now

Designation: Big Data Engineer

Educational Qualifications: B.Tech/M.Tech/MS/MCA

Experience: 3-9 Years

Job Description

The Big Data Engineer at Draup is responsible for building scalable techniques and processes for data storage, transformation, and analysis.

Job Overview

The role includes decision-making and implementation of the optimal, generic, and reusable data-platforms. You will work with a very proficient, smart and experienced team of developers, researchers and co-founders directly for all application use cases.

Primary Responsibilities

  • Develop, maintain, test and evaluate big data solutions within the organisation.
  • Build scalable architectures for data storage, transformation and analysis.
  • Design and develop solutions which are scalable, generic and reusable.
  • Build and execute data warehousing, mining and modelling activities using agile development techniques.
  • Leading big data projects successfully from scratch to production.
  • Creating a platform on top of stored data sources using a distributed processing environment like Spark for the users to perform any kind of ad-hoc queries with complete abstraction from the internal data points.
  • Solve problems in robust and creative ways.
  • Collaborate and work with Machine learning and harvesting teams.

Required Skills

  • Proficient understanding of distributed computing principles.
  • Must have good programming experience in Python.
  • Proficiency in Apache Spark (PySpark) is a must.
  • Experience with integration of data from multiple data sources.
  • Experience in technologies like SQL and NoSQL data stores such as Mongodb.
  • Good working Knowledge of MapReduce, HDFS, Amazon S3.
  • Knowledge of Scala would be preferable.
  • Should be able to think in a functional-programming style.
  • Should have hands-on experience in tuning software for maximum performance.
  • Ability to communicate complex technical concepts to both technical and non-technical audiences
  • Takes ownership of all technical aspects of software development for assigned projects.

What Will Give You an Advantage

  • Expertise in big data infrastructure, distributed systems, data modelling, query processing and relational.
  • Involved in the design of big data solutions with Spark/HDFS/MapReduce/Storm/Hive.
  • Worked with different types of file-storage formats like Parquet, ORC, Avro, Sequence files, etc.
  • Strong knowledge of data structures and algorithms.
  • Understands how to apply technologies to solve big data problems and to develop innovative big data solutions.
  • Someone with entrepreneurial mind-set delivering quick and efficient solutions with good design and architectural patterns will be preferred.
Found your fit? Apply now!
reCAPTCHA is required*
Each one at Draup is unified by the sole vision of building an amazing data product. We are proud to declare that Draup is an embodiment of equal opportunity principles. We do not unlawfully discriminate on the basis of gender identity or expression, race, ethnicity, religion, national origin, age, sex, marital status, physical or mental disability, veteran status, sexual orientation, and any other category protected by law.

Thank You for Applying

We are excited to see that you would like to build something big with Draup
Your application has reached us. It wouldn’t be long before our response reaches you.

Skip to main content Skip to footer