PerthAmboyRecruiter Since 2001
the smart solution for Perth Amboy jobs

Lead Data Engineer

Company: Penske
Location: Reading
Posted on: November 20, 2024

Job Description:

Summary Statement: Working with a team, you will lead the technical design, engineering, and support of complex data integrations between business-critical applications and systems. You will also participate in defining and implementing data engineering and analytics strategies; and mentor other data engineers on data engineering best practices to create our next generation of innovative solutions for our customers. What You Will Be Doing: As a Senior Data Engineer, you will be leading the effort to develop, enhance, and support existing and new data pipelines, data ingestions, data storage, and traditional Data-warehouse/BI systems across medium and large-sized projects concurrently. You will support our software developers, database architects, data analysts, and data scientists on vital initiatives and ensure optimal data delivery architecture consistent throughout ongoing projects. You will have the opportunity to influence our data and analytics roadmap through constant interactions with various business and technology teams. You will lead the design of vital components and suggest/implement new frameworks and tools based on industry and technological trends and advances. You will also consult with process owners in reviewing, interpreting & developing systems per user requirements and ensuring code quality through proper documentation, best practices, and code reviews. Working in our collaborative environment, you will further develop your skills while also acting as a mentor and technical guide to other associate data engineers. Penske Responsibilities: Be the primary contact and lead support associate for multiple critical projects/data pipelines and integrations and resolve customer issues promptly. Collaborate with technical/business leaders, product owners, software engineers, data architects, and data analysts to acquire and understand requirements/acceptance criteria. Participate in defining Data Engineering Process and Technology strategies. Provide day-to-day task leadership and project reviews. Communicate status and issues to team members and stakeholders. Produce deliverables for medium to large-sized projects with clean, well-documented, and easily maintainable code that adheres to defined coding standards. Design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Partner with cross-functional teams to build analytics tools that utilize the data pipeline to provide actionable insights into key business performance metrics. Participate in building data security and data governance guidelines Participate in Design and Deploy Tollgate reviews and gain buy-in from cross-functional teams including QA, Architect, Security, Webmaster, and Operations. Contribute and influence the discovery and decision-making process when changes to standards and technology are required (tools, conventions, and design patterns). Assign projects and review deliverables from onshore and offshore software engineers. Provide constructive input to department management regarding team members assigned to the project. Independently conduct new hire interviews. Design and manage data models to handle large datasets of existing structured and unstructured data. Research and discover new methods to acquire data, and new applications for existing data and stay up to date with the industry standards. Stay current with the rapidly developing Data Engineering landscape and share knowledge internally and with customers. Create recommendations for increasing data utilization based on an understanding of the data delivery environment. Other duties as assigned. Penske Qualifications: Bachelor's degree in computer science/computer engineering or equivalent years of software development experience required. 10+ years of overall technology experience. 8+ years of Data Engineering, Data Modeling, and Data Warehousing experience required. 2+ years of experience working with Agile teams preferred. 1-2 years of experience leading medium to large projects. Expert knowledge of full data engineering lifecycle. Exposure to Data Lake, Lake House concepts, and technologies like Snowflake, AWS RedShift, or Databricks. Experience in multidimensional data modeling, logical, physical, and star schemas, snowflakes, and de-normalized models. Experience in handling Big Data, IOT Data, and specifically a variety of Big Data file Formats Avro, Parquet, etc. Expertise in cloud technologies preferably AWS. Expert experience with Data Engineering tools such as Talend, SAP BODS, Kafka, Python, PySpark, Python APIs, Kubernetes, S3, Glue, Athena, EMR, etc. Exposure to BI & analytics tools such as Qlik Sense, Sagemaker, SAS Viya, and Dataiku Experience in handling purposeful database platforms that include Relational, Key-Value, In-Memory, Document, Time series, and Geospatial data stores. With a strong SQL background. Expert experience in building data pipelines, data ingestions, data integrations, data preparations, data transformation, data structures, metadata, and traditional Data warehouses and Data Marts Strong analytic skills related to working with complex datasets. Expertise in designing, validating, and implementing multiple projects across the hybrid infrastructure (On-cloud to On-Premises and vice versa) In-depth knowledge of appropriate design frameworks and patterns and experience in implementing them. Knowledge of industry-wide technology strategies and best practices Understanding of message queuing, stream processing, and highly scalable 'big data' data stores Solid written and oral communication skills; ability to present ideas in business-friendly and user-friendly language Physical Requirements: -The physical and mental demands described here are representative of those that must be met by an associate to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions. -The associate will be required to: read; communicate verbally and/or in written form; remember and analyze certain information; and remember and understand certain instructions or guidelines. -While performing the duties of this job, the associate may be required to stand, walk, and sit. The associate is frequently required to use hands to touch, handle, and feel, and to reach with hands and arms. The associate must be able to occasionally lift and/or move up to 25lbs/12kg. -Specific vision abilities required by this job include close vision, distance vision, peripheral vision, depth perception and the ability to adjust focus. Penske is an Equal Opportunity Employer. About Penske Truck Leasing Penske Truck Leasing Co., L.P., headquartered in Reading, Pennsylvania, is a partnership of Penske Corporation, Penske Automotive Group and Mitsui & Co., Ltd. A leading global transportation services provider, Penske operates a premier fleet of vehicles and serves its customers from locations in North America, South America, Europe, Australia, and Asia. Penske's product lines include full-service truck leasing, contract maintenance, commercial and consumer truck rentals, used truck sales, transportation and warehousing management and supply chain management solutions. Visit www.GoPenske.com to learn more Job Category: Information Technology Job Family: Analytics & Intelligence Address: 100 Gundy Drive Primary Location: US-PA-Reading Employer: Penske Truck Leasing Co., L.P. Req ID: 2408279 Date posted: 11/19/2024

Keywords: Penske, Perth Amboy , Lead Data Engineer, Professions , Reading, New Jersey

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest New Jersey jobs by following @recnetNJ on Twitter!

Perth Amboy RSS job feeds