LogoLogo
  • Preen
  • Getting Started
    • Installation
    • Hello World
      • Configuring Sources
      • Creating Models
  • Concepts
    • Overview
    • Sources
    • Models
    • Validation
  • Documentation
    • Config
      • Sources
      • Models
    • Integrations
      • Databases
        • Postgres
        • MySQL
        • MongoDB
      • Cloud Blob Storage
        • Amazon S3
      • File Formats
        • CSV
Powered by GitBook
On this page
  • Model Configuration Options
  • Code References
  1. Documentation
  2. Config

Models

how to configure preen models.

PreviousSourcesNextIntegrations

Last updated 7 months ago

Preen models are defined as a YAML file. The model file is used to define the data sources, the query to be executed, and the type of query to be executed.

Model Configuration Options

Option
Description
Required
Applicable Types

name

The unique name of the model

Yes

All

type

The type of the model (e.g.database, file)

Yes

All

format

The format of the data (e.g. csv)

Only for file type

file

query

The query to be executed

Yes for database type

database

options

Additional options for the model (e.g., file format, delimiter, header)

No

All (specific options vary by type)

file_patterns

The file patterns to be used for matching files

Only for file type

file

collection

The name of the collection to query

Only for database type

Used for MongoDB sources

Code References

models.go