Data Engineering

World gate recruiter team is looking for a full-time Data Engineer with great experience to join us on our mission to help people learn and also help our client. We are looking for someone who is a proven designer and implementer of micro-services and complex Engineer systems

The data engineer role requires knowledge in programming for integrating complex models and using a software library frameworks to distribute large, clustered data sets. Data engineers collect and arrange data in a form that is useful for analytics. A basic knowledge in machine learning is also required to build efficient and accurate data pipelines to meet the needs for downstream users such as data scientists to create the models and analytics that produce insight.

Responsibilities:

• Build data pipelines and applications for processing datasets
• Develop infrastructure for data extraction, transformation, and loading using SQL, NoSQL, and Kafka
• Collaborate with team members to design and implement data solutions
• Build analytics tools to provide insights into business metrics
• Track data lineage, ensure data quality, and improve data discoverability
• Work in an Agile environment and interact with multi-functional teams

Requirements:

• Strong Java & Python development experience
• 3+ years of data engineering experience building large data pipelines
• Strong SQL and NoSQL skills
• Experience with relational SQL and NoSQL databases
• Hands-on experience with distributed systems such as Spark and Hadoop
• Experience with message queuing and stream data processing using Kafka Streams
• Strong analytic skills for working with unstructured datasets

Benefits

• Healthcare, Vision, and Dental Insurance
• 20 Days of PTO
• 401K Matching
• Training/Certification Reimbursement
• Short term/Long term disability
• Life Insurance
• $130,000-$150,000 yearly base on experience
• United states applicants only
• No Visa sponsorship