Data Engineer Job at Brooksource, Cincinnati, OH

SllUd0d1L1FUQjN1UE1zdUpuZ0F0aDl2dEE9PQ==
  • Brooksource
  • Cincinnati, OH

Job Description

Location: Cincinnati, OH or Blue Ash, OH (Must)

The Logging & Data Ingestion Engineer will play a pivotal role in optimizing log ingestion, parsing, and analytics using CRIBL and other observability tools. The ideal candidate will have extensive experience in managing logs across multiple cloud platforms, tuning ingestion pipelines, and working with APIs to ensure seamless data flow and analysis.

Key Responsibilities:

  • Design, implement, and optimize log ingestion pipelines utilizing CRIBL and other log management tools.
  • Develop and maintain log parsing strategies to improve searchability and analysis.
  • Work with APIs to ingest, transform, and route log data efficiently.
  • Optimize log formats and ingestion performance across AWS, Azure, and Google Cloud environments.
  • Ensure effective log retention, storage, and compliance with security standards.
  • Collaborate with DevOps, Security, and Application teams to enhance observability and troubleshooting capabilities.
  • Monitor logging infrastructure for performance issues and propose enhancements.
  • Provide expertise in log-based alerting and monitoring strategies.

Required Qualifications:

  • 3+ years of experience in log ingestion, parsing, and management.
  • Strong expertise in CRIBL , log formatting, and log tuning.
  • Experience working with logging and monitoring tools (e.g., Splunk, ELK, Datadog, New Relic).
  • Proficiency in working with APIs for log ingestion and transformation.
  • Hands-on experience with AWS, Azure, and Google Cloud logging services.
  • Understanding of data pipelines and streaming log architectures.
  • Knowledge of security and compliance requirements for log management.
  • Strong problem-solving and analytical skills with a focus on performance optimization.

Preferred Qualifications:

  • Experience with scripting languages (e.g., Python, Bash) for automation.
  • Familiarity with Kubernetes, containers, and microservices architecture.
  • Certification in cloud platforms (AWS, Azure, GCP) is a plus.

Job Tags

Similar Jobs