Data Engineer
About the Company
At Bloomfield, we are revolutionizing the way crops are monitored and managed. Our AI-powered imaging technology provides continuous, plant-level health and performance insights from seed to harvest. Our mission is to empower farmers with the tools they need to increase crop productivity and quality while using fewer scarce resources, ultimately contributing to a more sustainable and food-secure future.
In 2024, Kubota Corporation, a global leader in agricultural machinery and solutions, through its North American subsidiary, Kubota North America Corporation, acquired Bloomfield. This acquisition unites Bloomfield’s innovative technology with Kubota’s extensive resources and commitment to provide comprehensive smart agriculture solutions to farmers worldwide. Our combined expertise and resources will drive innovation and deliver benefits to farmers, ensuring a more sustainable and prosperous agricultural industry.
About the Role
Our rapidly growing engineering team is searching for a Data Engineer to help build and maintain our data and image processing pipelines. You will be responsible for designing, implementing, and maintaining the various components of our pipelines, which need to support processing more than 75k images per day. You will be involved in all parts of the data engineering lifecycle, including data generation, ingestion, transformation, storage, and serving of our data.
To be successful in this role, you should have a strong background in software engineering and be proficient in Python. Familiarity with AWS technologies such as Lambdas, Step Functions, Redshift, S3, Athena, and Glue is a big plus.
As a Data Engineer, you will be a part of our engineering team, working to ensure that our data ecosystem is efficient, scalable, and able to support our rapidly growing data needs. You will be responsible for ensuring that the data is cleaned, processed, and transformed appropriately to support our data analytics and machine learning efforts.
Responsibilities
- Designing, implementing, and maintaining our data pipeline, including data schema definition, ingestion, transformation, and serving
- Ensuring the reliability, quality, security, and performance of the data pipelines
- Troubleshooting and debugging any issues with our data pipelines
- Working with other engineers to understand their data needs and ensure that our data ecosystem can support their requirements
- Optimizing the data pipeline for efficiency, scalability, and reliability
- Developing and maintaining documentation for the data pipeline
While this is primarily a remote position, we ask that candidates live in Paris, France and join the team in a co-working space once per week.
Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or a similar field
- 5+ years of experience as a Data Engineer or a similar role
- Strong proficiency in dbt, SQL and Python
- Good knowledge of data warehouse solutions such as GCP BigQuery, AWS Redshift, experience with Dremio is a plus
- Experience with Data Warehouse design and maintenance
- Experience with real Data monitoring and alerting in production
- Experience with self-serve BI tools such as Metabase, Looker, Tableau - experience with LightDash is a plus
- Familiarity with data cleaning, processing, and analytics of image data
- Strong problem-solving and troubleshooting skills
- Excellent communication and collaboration abilities