LogoLogo
  • Preen
  • Getting Started
    • Installation
    • Hello World
      • Configuring Sources
      • Creating Models
  • Concepts
    • Overview
    • Sources
    • Models
    • Validation
  • Documentation
    • Config
      • Sources
      • Models
    • Integrations
      • Databases
        • Postgres
        • MySQL
        • MongoDB
      • Cloud Blob Storage
        • Amazon S3
      • File Formats
        • CSV
Powered by GitBook
On this page
  • Overview
  • Definition
  • Examples
  • Databases
  • Amazon S3
  1. Concepts

Sources

what is a source?

Overview

A Preen Source is any data storage system that is listed under the Integrations section, such as a relational database (e.g. Postgres, MySQL etc.), NoSQL database (MongoDB) or file store (Amazon S3).

Definition

A Source is a storage system-dependent configuration that specifies:

  1. The name of the source

  2. The type of the source

  3. The connection details for the source

Examples

Databases

sources:
  - name: users-db-us-east-1
    engine: mysql
    connection:
      host: localhost
      port: 5432
      database: mydatabase
      user: ${DB_USER}
      password: ${DB_PASSWORD}
    models:
      - users

Amazon S3

sources:
  - name: users-s3-us-east-1
    engine: s3
    connection:
      bucket_name: users-bucket
      region: us-east-1
    models:
      - users

For detailed configuration reference see Sources

PreviousOverviewNextModels

Last updated 6 months ago