As a python developer working within the Xecta Platform and Infrastructure team, the candidate will bring value to the organization by engineering customer-specific data ingestion solutions. The candidate will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross-functional teams. The ideal candidate is an experienced python developer with experience building Object-Oriented solutions in Python from the ground up.
The solutions will typically be based on commonly used ETL/Ingestion tools such as Apache Airflow and Kafka. The candidate will use their skills to engineer data pipelines that provide batch, scheduled, and in specific cases, push-based data pipelines for relational data, unstructured files, REST and Socket-based sources. The candidate with use their programming skills (e.g. python) and knowledge of the Data Engineering landscape to apply the best solution to meet our customer(s) requirements. You will work closely with our Lead Data Engineers to design a solution, articulate that solution to leadership and to implement the solution working with both Xecta Engineers and the Customer data teams.
- Build Data Engineering platform using Python
- Design data engineering pipelines that ingest data from customer hosted systems to Xecta Cloud Platform
- Code python scripts as needed to apply logic and replace missing/bad data on a per-pipeline basis
- Setup triggers, ingestion schedules for batch loading on a per-pipeline basis
- Deploy, test and refine data engineering solution
- Work with customer data teams to ensure the robustness and security of data pipeline solution
- Good working experience with Python
- Experience writing test cases using Pytest or any other Python testing package
- Experience with Pymongo and other python database libraries
- Experience using Flask or other Python Web Frameworks
- Experience using Numpy and Pandas
- Experience with Object-Oriented Programming using Python
- Understanding of design patterns
Xecta Digital Labs is where physics intersects artificial intelligence to create the next-gen cognitive digital solutions for the energy industry. Our software products and digital solutions provide practical and robust workflows for energy companies.
- Category : Information Technology & Telecom
- Salary : $1.00
- Valid Through : 2021-10-13 12:00:00
- Company Name : Xecta