Find jobs in Oregon today!

To post a job, login or create an account |  Post a Job

  Jobs in Oregon  

Bringing the best, highest paying job offers near you

previous arrow
next arrow
Slider

Sr. Data Engineer

BizTek People, Inc.

This is a Full-time position in Beaverton, OR posted April 1, 2021.

We are looking for a talented Sr. Data Engineer. Responsibilities Develop, mentor, design and implement features in collaboration with team engineers, product owners, data analysts, and business partners using Agile Scrum methodology Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes Design and implement distributed data processing pipelines using Spark, Hive, Sqoop, Python, and other tools and languages prevalent in the EMR ecosystem Build utilities, user defined functions, and frameworks to better enable data flow patterns Research, evaluate and utilize new technologiestoolsframeworks centered around high-volume data processing Define and apply appropriate data acquisition and consumption strategies for given technical scenarios Build, incorporate, and drive teams to write automated unit tests and integration scripts using the Python test unit framework Work with architectureengineering leads and other teams to ensure quality solutions are implemented, and engineering standard methodologies are defined and adhered to Work across teams to resolve operational and performance issues and to deliver data for reporting in Tableau Implement security control around sensitive data Requirements MSBS in Computer Science, or related technical field 5+ years of proven experience and 5+ years of relevant big dataETL data warehouse experience building data pipelines 2+ years leading a team of data engineers ndash IE mentor, improve processes, peer training, coding standards 3+ yearsrsquo experience in Python and Snowflake. Strong programming experience in Python Professionally worked with APIs to extract data for data pipelines Extensive experience working with Hadoop and related processing frameworks such as Spark, Hive, Sqoop, etc. Ability to architect, design and implement solutions with AWS Virtual Private Cloud, EC2, AWS Data Pipeline, AWS Cloud Formation, Auto Scaling, AWS Simple Storage Service, EMR and other AWS products, HIVE, Athena Solving production issues and performing On-Call duties, at times Working knowledge with workflow orchestration tools like Apache Airflow Hands on experience with performance and scalability tuning Experience with AgileScrum application development using JIRA Experience working in a public cloud environment, particularly AWS Professional experience with source control, merging strategies and coding standards, specifically BitbucketGit

Please add your adsense or publicity code here (inc/structure/adsfooter.php)