Data Engineer
Shamrock Trading Corporation Overland Park, KS
Security verification
Shamrock Trading Corporation Overland Park, KS
3 days ago
See who Shamrock Trading Corporation has hired for this role
Shamrock Trading Corporation Overland Park, KS
3 days ago
Security verification
Save job
Welcome back
Sign in to save Data Engineer at Shamrock Trading Corporation.
- Report this job
Direct message the job poster from Shamrock Trading Corporation
Nickie (Branting) Firkins
Technical Recruiting Lead at Shamrock Trading Corporation
DescriptionCompany OverviewShamrock Trading Corporation is the parent company for a family of brands in transportation services, finance and technology. Headquartered in Overland Park, KS, Shamrock is frequently recognized among the “Best Places to Work” in Kansas City and Chicago and was most recently recognized as one of America’s top 100 “Most Loved Workplaces” by Newsweek. We also have offices in Atlanta, Chicago, Dallas, Ft. Lauderdale, Houston, Laredo, Nashville and Phoenix.
With an average annual revenue growth of 25% over several decades, Shamrock’s success is attributed to three key factors: hiring the best people, cultivating long-term relationships with our customers and continually evolving in the marketplace.
ResponsibilitiesShamrock Trading Corporation is looking for a Data Engineer who wants to utilize their expertise in data warehousing, data pipeline creation/support and analytical reporting skills by joining our Data Services team. This role is responsible for gathering and analyzing data from several internal and external sources, designing a cloud-focused data platform for analytics and business intelligence, reliably providing data to our analysts. This role requires significant understanding of data mining and analytical techniques. An ideal candidate will have strong technical capabilities, business acumen, and the ability to work effectively with cross-functional teams. Responsibilities include but are not limited to:
- Work with Data architects to understand current data models, to build pipelines for data ingestion and transformation.
- Design, build, and maintain a framework for pipeline observation and monitoring, focusing on reliability and performance of jobs.
- Surface data integration errors to the proper teams focusing on:
- Ensuring timely processing of new data
- Performance of data pipelines
- Integrity and quality of source data
- Hands-on experience building data-lake style infrastructures using streaming data set technologies (particularly with Apache Kafka)
Qualifications
- Bachelor’s degree in computer science, data science or related technical field, or equivalent practical experience
- Experience building and maintaining AWS based data pipelines: currently utilizing AWS Lambda, Docker / ECS, MSK, Airflow, Databricks, Unity Catalog
- Development experience utilizing two or more of the following:
- Python: (Pandas/Numpy, Boto3, SimpleSalesforce)
- Databricks (pySpark, pySQL, DLT)
- Apache Spark
- Kafka and the Kafka Connect ecosystem (schema registry and Avro)
- Terraform (or other infrastructure as code platform)
- Enthusiasm for working directly with customer teams (Business units and internal IT)
Preferred Qualifications
- Proven experience with relational and NoSQL databases (e.g. Postgres, Redshift, MongoDB)
- Experience with version control (git) and peer code reviews
- Familiarity with data visualization techniques using tools such as Grafana, PowerBI, AWS Quick Sight, and Excel
Benefits PackageAt Shamrock we hire bright, ambitious people and give them the tools they need to be successful. By investing in training and development, we hope to become a long-term career for employees, where there are always opportunities for advancement. Shamrock also offers a premier set of benefits for employees and their families:
- Medical: Fully paid healthcare, dental and vision premiums for employees and eligible dependents
- Work-Life Balance: Competitive PTO and paid leave policies
- Financial: Generous company 401(k) contributions and employee stock ownership after one year
- Wellness: Onsite gym and discounted membership to select fitness centers. Jogging trails available at Overland Park offices
-
Seniority level
Entry level -
Employment type
Full-time -
Job function
Information Technology -
Industries
Truck Transportation
Referrals increase your chances of interviewing at Shamrock Trading Corporation by 2x
See who you know
Get notified about new Data Engineer jobs in Overland Park, KS.
Sign in to create job alert
Similar jobs
-
Software Engineer
Software Engineer
Fieldguide
San Francisco, CA
-
Junior React Developer
Junior React Developer
Team Remotely Inc
Philadelphia, PA
-
Software Engineer
Software Engineer
Fay
San Francisco, CA
-
Software Engineer (Remote)
Software Engineer (Remote)
The Home Depot
United States
-
Entry Level Software Engineer (Remote)
Entry Level Software Engineer (Remote)
Engtal
United States
-
Software Engineer (Remote)
Software Engineer (Remote)
The Home Depot
United States
-
Software Engineer (Remote)
Software Engineer (Remote)
Canny
United States
-
Software Engineer - Frontend
Software Engineer - Frontend
Ever
San Francisco, CA
-
Junior Full Stack Engineer
Junior Full Stack Engineer
Humana
United States
-
Software Engineer I
Software Engineer I
Microsoft
Redmond, WA
-
Junior Software Developer Trainee
Junior Software Developer Trainee
Team Remotely Inc
Providence, RI
-
Jr Web Developer (Entry Level)
Jr Web Developer (Entry Level)
Planned Systems International
United States
-
Software Engineer (LA Remote)
Software Engineer (LA Remote)
Prelim
Los Angeles, CA
-
Junior Software Engineer
Junior Software Engineer
First Advantage
Atlanta, GA
-
Software Engineer
Software Engineer
Check
New York, NY
-
Software Engineer (L5) - Ads Platform Engineering
Software Engineer (L5) - Ads Platform Engineering
Netflix
United States
-
Software Engineer
Software Engineer
Check
San Francisco, CA
-
Software Engineer Internship
Software Engineer Internship
Databento
Chicago, IL
-
Software Engineer (Front End)
Software Engineer (Front End)
Edmunds
Santa Monica, CA
-
Junior Node.JS Developer
Junior Node.JS Developer
Team Remotely Inc
Portland, OR
-
JavaScript Developer
JavaScript Developer
Team Remotely Inc
Portland, OR
-
Junior Software Engineer (Remote)
Junior Software Engineer (Remote)
SynergisticIT
Cleveland, OH
-
Software Engineer - Fullstack
Software Engineer - Fullstack
Ever
San Francisco, CA
-
Software Engineer I - (Full Stack)
Software Engineer I - (Full Stack)
iSqFt
Cincinnati, OH
-
Junior Python Developer
Junior Python Developer
Team Remotely Inc
Philadelphia, PA
-
Junior Web Developer
Junior Web Developer
Team Remotely Inc
Philadelphia, PA
-
Software Engineer
Software Engineer
Taskrabbit
Denver, CO
People also viewed
-
Junior Software Development Engineer
Junior Software Development Engineer
Team Remotely Inc
Providence, RI
-
Junior React Developer
Junior React Developer
Patterned Learning Career
Fayetteville, AR
-
Front End Engineer
Front End Engineer
Teal
United States
-
Junior Backend Software Engineer
Junior Backend Software Engineer
Netography
Annapolis, MD
-
Software Engineer
Software Engineer
Warp
New York, NY
-
Junior Software Engineer
Junior Software Engineer
First Advantage
United States
-
Software Engineer (L4), Content Engineering
Software Engineer (L4), Content Engineering
Netflix
United States
-
Software Engineer - Backend
Software Engineer - Backend
Ever
San Francisco, CA
-
Software Engineer, Front End (Proto)
Software Engineer, Front End (Proto)
Block
New York, NY
-
Software Engineer I
Software Engineer I
GitHub
United States
Looking for a job?
Visit the Career Advice Hub to see tips on interviewing and resume writing.
View Career Advice Hub