Back to Portfolio
PersonalPersonal EngineeringDaily Automated Insights

IDX Shareholder Insider Tracker

A serverless data pipeline tracking >5% ownership changes on the Indonesia Stock Exchange (IDX), replacing manual PDF analysis with a consolidated daily dashboard.

PythonGoogle Cloud FunctionsBigqueryLooker Studio

The Challenge

The Indonesia Stock Exchange (IDX) releases data on >5% ownership changes daily, but it is buried in fragmented PDF reports.

  • The Friction: Investors currently have to download and open files one by one to check if major shareholders are accumulating or dumping stock.
  • The Goal: Automate the extraction to visualize "Net Change" and accumulation trends instantly.

The Stack (Serverless Architecture)

  • Ingestion: Google Cloud Functions (Python Scraper).
  • Storage (Raw): Google Cloud Storage (GCS).
  • Transformation: BigQuery (SQL Data Warehousing).
  • Visualization: Looker Studio.

The Architecture

Image

The Engineering Logic

I built a fully serverless pipeline to minimize cost and maintenance.

  1. Scrape: A Python script deployed on Cloud Functions triggers daily. It parses the IDX portal and downloads the raw reports.
  2. Store: Raw data is dumped immediately into Google Cloud Storage (Data Lake) for auditability.
  3. Transform: BigQuery ingests the raw files and runs SQL transformations to calculate the "Net Change" (Current Holdings - Previous Holdings).
  4. Visualize: The Looker Studio dashboard connects to the view, ready for consumption by D+1 morning.

The Insights (Value Provided)

  • Net Change Tracker: Instantly identifies which Major Shareholder (e.g., Controllers, Institutions) is reducing or adding positions.
  • Trend Analysis: Visualizes the accumulation vs. distribution patterns over time, helping investors spot "Smart Money" movements before the price reacts.

Links

Download File

Click to view file