Database / Data Engineer

Full Time
  • Full Time
  • Bengaluru
  • Applications have closed

Job Summary

You will design and optimize the database architecture supporting marketplace modules. You’ll manage PostgreSQL (including TimescaleDB for time-series data), Elasticsearch for search, Redis for caching, and build ETL pipelines for analytics and reporting dashboards.

Key Responsibilities / Duties

Database Design & Management

Design PostgreSQL schemas for 40+ tables across 6 domains

Implement partitioning strategies for large tables (transactions, listings)

Configure TimescaleDB hypertables for time-series data

Write and optimize complex SQL queries

Manage database migrations (Alembic/golang-migrate)

Search & Analytics

Design Elasticsearch indices for multi-module search

Implement faceted search with aggregations

Build real-time analytics pipelines using Kafka + ClickHouse

Create reporting tables for dashboards (Entity Admin, Finance Manager)

Performance

Implement query optimization and indexing strategies

Configure read replicas for analytics workloads

Set up connection pooling (PgBouncer)

Monitor database performance (slow query logs, pg_stat_statements)

Data Governance

Implement data retention policies

Manage backup and recovery procedures

Ensure GDPR/CCPA compliance for data deletion

Implement data anonymization for M7 (Enterprise Data)

Required Skills & Qualifications

Must-Have (4+ years overall)

SkillProficiencyNotes

PostgreSQL4+ yearsPerformance tuning, partitioning, replication

SQL4+ yearsComplex joins, window functions, CTEs

Elasticsearch2+ yearsIndex design, aggregations, query DSL

Redis2+ yearsCaching, rate limiting

Python2+ yearsETL scripts

Database Migrations2+ yearsAlembic or golang-migrate

Preferred / Good-to-Have Skills

SkillWhy It Matters

TimescaleDBTime-series (price history, utilization metrics)

ClickHouseReal-time analytics

KafkaEvent streaming

Airflow / dbtETL orchestration

Metabase / SupersetDashboarding

pgvectorVector search for AI features

Key Tables / Data Models

Transactions: tables – transactions, escrow_holds | Row growth estimate – 10M/year

Listings: tables – listings, listing_versions | Row growth estimate – 5M/year

Price History: tables – price_history (TimescaleDB) | Row growth estimate – 100M/year

AI Conversations: tables – ai_conversations | Row growth estimate – 50M/year

Interview Process

Round 1 – PostgreSQL + SQL optimization: 60 minutes

Round 2 – Elasticsearch + Search design: 60 minutes

Round 3 – Data pipelines + ETL: 45 minutes

Round 4 – Hiring Manager: 45 minutes

Similar Jobs to Apply