Big Data Engineer
Job Description Template

Job Overview 

Our IT company is looking for a Big Data Engineer to help us with our big data requirements. In this job role, you will be responsible for developing and maintaining Hadoop systems. Besides, you should have strong analytical skills that will help you in examining and understanding the company’s big data needs. You should be able to develop and implement big data solutions. 

You will also be responsible for handling communications between internal systems and the survey vendors. Moreover, you should be able to create and maintain an effective data pipeline architecture. To perform in this job role, you should be familiar with big data tools, scripting languages, and various cloud services.  

As a Big Data Engineer, you should have good time and project management skills. Furthermore, you should be detail-oriented and have the ability to manage strict deadlines. A successful candidate should also have prior work experience in this job role.  

If you can ensure success as a Big Data Engineer, then do get in touch with us. We would love to have a word with you.  

Responsibilities 

• Developing and maintaining Hadoop systems 

• Analyzing and determining the company’s big data needs 

• Coordinating with the software development teams to finalize the scope of the system 

• Developing and delivering big data solutions 

• Developing company applications by building cloud platforms 

• Handling preprocessing services using Pig or Hive 

• Managing loading from disparate data sets 

• Handling communications between internal systems and survey vendors 

• Developing and maintaining production systems 

• Creating data pipeline architecture 

• Planning and optimizing data delivery 

• Using SQL and AWS to load data from various data sources 

• Assisting in rectifying any data-related technical issues 

Requirements 

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field 

• 3-5 years of work experience as a Big Data Engineer, Data Analyst, Data Architect or a similar role in the IT and Development industry 

• Familiarity with big data tools such as Hadoop, Kafka, and Spark 

• Understanding of various scripting languages 

• Complete knowledge of AWS cloud services and SQL and NoSQL databases 

• Good time management and project management tools 

• Impressive communication and interpersonal skills 

• Ability to work independently and collaboratively 

• Excellent technical skills 

• Highly motivated and detail-oriented individual 

• Ability to work under pressure and manage strict deadlines 

• Strong analytical and problem-solving skills 

• Ability to offer excellent customer service