Data Engineer Job

Spreadsheet Broccoli is looking for a Data Engineer to join our team in New York, NY.

About Spreadsheet Broccoli:
We provide CSV and Excel processing tools with 500+ integrations for e-commerce, accounting, and business platforms. Our online tools convert, validate, import, connect, integrate, reconcile, migrate, and process CSV and Excel files with no signup required.

Role Overview:
As a Data Engineer, you will design, build, and maintain scalable data pipelines and infrastructure that power our data processing platform. You will work closely with cross-functional teams to ensure reliable data flow across our 500+ integrations.

Responsibilities:
- Design, develop, and maintain robust data pipelines for CSV and Excel file processing at scale
- Build and optimize ETL/ELT workflows to support e-commerce, accounting, and business platform integrations
- Develop and maintain data models, schemas, and architectures that support our integration platform
- Monitor and troubleshoot data pipeline performance, ensuring high availability and data quality
- Collaborate with software engineers and product teams to implement new data integrations
- Implement data validation, reconciliation, and migration processes
- Optimize database performance and query efficiency
- Write clean, well-documented, and testable code
- Participate in code reviews and contribute to engineering best practices

Qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field
- 3+ years of experience in data engineering or a similar role
- Strong proficiency in Python and SQL
- Experience with data pipeline frameworks (e.g., Apache Airflow, dbt, Luigi)
- Familiarity with cloud platforms (AWS, GCP, or Azure)
- Experience with relational and non-relational databases
- Knowledge of data warehousing concepts and best practices
- Experience working with CSV, Excel, and various file formats
- Strong problem-solving skills and attention to detail

Nice to Have:
- Experience with e-commerce or accounting platform APIs
- Familiarity with data integration and ETL tools
- Experience with containerization (Docker, Kubernetes)
- Knowledge of streaming data technologies (Kafka, Spark Streaming)

Location: New York, NY 10003
Company: Spreadsheet Broccoli (spreadsheetbroccoli.com)

CSV and Excel processing tools with 500+ integrations for e-commerce, accounting, and business platforms. Online tools to convert, validate, import, connect, integrate, reconcile, migrate and process CSV and Excel files. No signup required.