Lead Data Engineer Job at Egen, Naperville, IL

dGRzbnZBcXkyN1p2NVBFTEJKUEd1S08yM3c9PQ==
  • Egen
  • Naperville, IL

Job Description

\n

Job Description:
  • Responsible for designing and building data pipelines.
  • Designing and implementing solutions and developing applications utilizing airflow, dataflow, Apache beam, snowflake or GCP components.
  • Reading, extracting, transforming, staging, and loading data to multiple targets, using Hadoop, Hive, Snowflake, BigQuery, and Cloud Storage.
  • Migrating existing data processing from standalone or legacy technology scripts to distributed framework processing.
  • Working with gigabytes/terabytes of data and dealing with the challenges of transforming and enriching such large datasets.
  • Utilizing Google Cloud Platform and strong big data technology foundation 
  • Designing and Architecting data model to modernize legacy data warehouses.
  • Writing ELT jobs using DBT to maintain data lineage and data auditability.
  • Designing architecture of CI/CD pipelines to perform continuous build and isolate multiple environments.

Experience/Qualifications
  • Master’s or foreign academic equivalent in Business Analytics, Computer Science, Statistics, Data Science or any related field plus one (1) year of experience. Location: Northridge, CA, telecommuting permitted, HQ in Naperville, IL. Approx. 25% domestic travel required. Travel Expenses to be paid by employer. One year of experience with Hadoop, Spark, Pig, Hive, Snowflake, BigQuery, Kubernetes, and Dataflow required.

\n

SALARY: $116,334 per year

BENEFITS: Medical Insurance, Dental, Life Insurance, Paid Time Off, 401(k)

WHERE TO APPLY: SpringML, Inc. dba Egen Solutions, 40 Shuman Blvd, Suite 204, Naperville, IL;

Email:  hr@egen.ai

EEO and Accommodations:

Egen is an equal opportunity employer and is committed to inclusion, diversity, and equity in the workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability status, protected veterans’ status, or any other characteristic protected by federal, state, or local laws. Egen will also consider qualified applications with criminal histories, consistent with legal requirements. Egen welcomes and encourages applications from individuals with disabilities. Reasonable accommodations are available for candidates during all aspects of the selection process. Please advise the talent acquisition team if you require accommodations during the interview process.

Job Tags

Full time, Local area, Remote work,

Similar Jobs

Arizon RFID Technology (Cayman) Co., Ltd.

HR & Admin Associate Job at Arizon RFID Technology (Cayman) Co., Ltd.

 ...work closely with both the US Managing Director and the Global HR Director based in Asia. Initially, you will help coordinate with...  ...onboarding logistics, and leave tracking Assist with early-stage internship outreach and other local talent coordination efforts as needed... 

Cascadia Global Security

Armed Security Supervisor Job at Cascadia Global Security

 ...Job Description Job Description About the position: Position: Armed Security Supervisor Location: Austin, TX Employment type: Full Time Pay: $23 Daily pay options are available. Payout as soon as the next day! Hiring Immediately! Available Shifts... 

TempAI

Founding Customer Success Manager Job at TempAI

 ...by Offline Studio and backed by Offline Ventures. Role Description This is a full-time remote role for a Founding Customer Success Manager. The Founding Customer Success Manager will be responsible for managing customer relationships, ensuring customer satisfaction... 

Synergis

UI/UX Designer (Marketing) Job at Synergis

 ...Job Title: UI/UX Designer (Marketing) Location: Coral Gables, FL Onsite 3 days/week Contract Type: W2, 6-Month Contract-to-Hire Pay Range: $40-43/hour About the Role We are seeking a talented UX/UI Designer with exceptional visual design skills... 

ZipRecruiter

HR Legal Consultant / Employment Attorney (Hybrid in Chicago) (Chicago) Job at ZipRecruiter

 ...Job DescriptionJob Description Job Title: HR Legal Consultant / Employment Attorney (Chicago) Company: The Wilkinson Firm Location: Chicago, Illinois area (Remote but Must be licensed in Illinois or highly familiar with Chicago Labor Law) About Us:...