Job ID: 53530
Senior Data Engineer
Our client is seeking a full-time Implement methods for improving data reliability and quality. Combine raw information from different sources to create consistent and machine-readable formats. Develop and test architectures that enable data extraction and transformation for predictive or prescriptive modeling.
Essential Duties and Responsibilities:
To perform this job successfully, an individual must be able to perform the following satisfactorily; other duties may be assigned. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Analyze and organize raw data
Build data systems and pipelines
Design infrastructure for scalability and optimizing data delivery
Evaluate business needs and objectives
Interpret trends and patterns
Conduct complex data analysis and report on results
Prepare data for prescriptive and predictive modeling
Build algorithms and prototypes
Combine raw information from different sources
Explore ways to enhance data quality and reliability
Identify opportunities for data acquisition
Develop analytical tools and programs
Collaborate with data scientists and architects on several projects
Build complex ETL jobs, preferably using Apache Nifi.
Design, build and maintain an enterprise data warehouse.
Participate in the data pipelines health monitoring and performance optimizations, as well as quality documentation.
Pipelines should be optimized to handle both real-time data, batch update data and historical data.
Establish scalable, efficient, automated processes for complex, large scale data analysis
Manipulate and analyze complex, high-volume, high-dimensional data from varying sources using a variety of tools and data analysis techniques.
To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below represent the knowledge, skill, and/or ability required.
Bachelor's degree from four-year college or university; or one to two years related experience and/or training; or equivalent combination of education and experience.
Proficiency in warehousing architecture techniques, including MOLAP, ROLAP, ODS, DM, and EDW.
Proven work experience as an ETL developer and proven ability to deliver high-quality work with minimal supervision.
Experience with Apache Nifi preferred.
Experience in various DevOps practices helping the client to deploy and scale the systems as per requirement.
Degree in Information systems, Informatics, Statistics, Computer Science, or another quantitative field.
Fluent in SQL, NoSQL, Big Data tools like Kafka, Spark or Hadoop, Azure or other Cloud Architecture, Python/C#/Java.
VanderHouwen is an award-winning, Women-Owned, WBENC certified professional staffing firm. Founded in 1987, VanderHouwen has been successfully placing experienced professionals throughout the Pacific Northwest and nationwide. Our recruitment teams are highly specialized in either Technology and IT, Engineering, or Accounting and Finance career markets. Our recruiters value building meaningful, professional relationships with each candidate as well as developing honed knowledge of companies' staffing needs and workplaces. Partner with us to land your next exciting career.
VanderHouwen is an Equal Opportunity Employer and participates in E-Verify. VanderHouwen does not discriminate on the basis of race, color, religion, sex, national origin, age, disability, or any other characteristic protected by applicable local, state or federal civil rights laws.