We are focused on the health and safety of our workforce, clients, and greater community. Our team is working hard (remotely) to support your staffing and job search needs. Please call us at 1-503-299-6811 and use the name directory, or email opportunities@vanderhouwen.com (monitored Mon-Fri 8 am-5 pm).
VanderHouwen is an Equal Opportunity Employer and stands with our fellow citizens and countrymen in the battle against all forms of racism and social injustice.
Read more about our commitment to diversity here.

Be well and stay safe!

Description

Job ID: 47677
Senior Data Engineer
Our client has embraced big data technologies to enable data-driven decisions.  They are looking to expand their Data Engineering team to keep pace.  As a Senior Data Engineer, you will work with a variety of talented teammates and be a driving force for building first-class solutions for technology and business partners, working on development projects related to supply chain, commerce, consumer behavior and web analytics among others.

Senior Data Engineer Responsibilities
Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
Translate product backlog items into engineering designs and logical units of work
Profile and analyze data for the purpose of designing scalable solutions 
Define and apply appropriate data acquisition and consumption strategies for given technical scenarios
Design and implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
Implement complex automated routines using workflow orchestration tools 
Work with architecture, engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and adhered to
Anticipate, identify and solve issues concerning data management to improve data quality
Build and incorporate automated unit tests and participate in integration testing efforts
Utilize and advance continuous integration and deployment frameworks
Troubleshoot data issues and perform root cause analysis
Work across teams to resolve operational & performance issues

Senior Data Engineer Qualifications
MS/BS in Computer Science, or related technical discipline
5+ years of experience in large-scale software development, 3+ years of big data experience
Strong programming experience, Python preferred
Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
Experience with messaging/streaming/complex event processing tooling and frameworks with an emphasis on Spark Streaming or Structured Streaming and Apache Nifi
Good understanding of file formats including JSON, Parquet, Avro, and others
Familiarity with data warehousing, dimensional modeling, and ETL development
Experience with RDBMS systems, SQL and SQL Analytical functions
Experience with workflow orchestration tools like Apache Airflow
Familiarity with data warehousing, dimensional modeling, and ETL development
Experience with performance and scalability tuning

The following skills and experience are also relevant to our overall environment, and nice to have:
Experience with Scala or Java
Experience working in a public cloud environment, particularly AWS, and with services like EMR, S3, Lambda, ElastiCache, DynamoDB, SNS, SQS, etc
Familiarity with cloud warehouse tools like Snowflake
Experience building RESTful API’s to enable data consumption
Familiarity with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
Familiarity with practices like Continuous Development, Continuous Integration and Automated Testing
Experience in Agile/Scrum application development

These are the characteristics that we strive for in our own work. We would love to hear from candidates who embody the same:
Desire to work collaboratively with your teammates to come up with the best solution to a problem
Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment
Excellent problem-solving and interpersonal communication skills
Strong desire to learn and share knowledge with others

Benefits
Benefits are available to eligible VanderHouwen contractors and include coverage for medical, dental, vision, life insurance, short and long term disability, and matching 401k.

About VanderHouwen 
VanderHouwen is an award-winning, Women-Owned, WBENC certified professional staffing firm. Founded in 1987, VanderHouwen has been successfully placing experienced professionals throughout the Pacific Northwest and nationwide.  Our recruitment teams are highly specialized in either Technology and IT, Engineering, or Accounting and Finance career markets. Our recruiters value building meaningful, professional relationships with each candidate as well as developing honed knowledge of companies' staffing needs and workplaces. Partner with us to land your next exciting career.

VanderHouwen is an Equal Opportunity Employer and participates in E-Verify. VanderHouwen does not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by applicable local, state or federal civil rights laws.

SIMILAR JOBS

Apply Now

Thank you for your interest in applying for this position! Please fill out the fields below. Your profile will be reviewed with the rest of the applicants.







Upload Your Resume (Required)

Not Ready to Apply?