0 / 0
Go back to the English version of the documentation
Pravidla pro vytváření sestav pravidel kvality dat
Last updated: 27. 7. 2023
Pravidla pro vytváření sestav pravidel kvality dat

Zkontrolujte, zda příkazy Postgresa Db2 pro tabulky souvisí s funkcí qulaity.

Oblast předmětu Název tabulky Popis
Pravidla kvality údajů dq_issues_for_asset_columns Otázky kvality dat pro sloupec.
Pravidla kvality údajů dq_issues_for_assets Záležitostí bylo pozorováno, když aktiva projdou analýzou kvality, aby se určila celková kvalita dat.
Pravidla kvality údajů dq_kontroly Informace o kontrolách kvality dat.
Pravidla kvality údajů dq_v4_dimensions Informace o dimenzích kvality pravidla pro příklad, zda existují duplikáty.
Pravidla kvality údajů dq_rule_definitions Definice pravidla kvality dat.
Pravidla kvality údajů dq_rules_defs Definice pravidel kvality dat.
Pravidla kvality údajů dq_rules Informace o pravidle kvality dat.
Pravidla kvality údajů dq_pravidla_vazby Vazby pravidla pro pravidlo kvality dat.
Pravidla kvality údajů dq_rule_execution Naplánovaný čas pro úlohu pravidla kvality dat.

tabulka dq_issues_for_asset_columns

Tato tabulka má následující sloupce:

  • issue_id -Identifikátor záležitosti aktiva.
  • asset_id -Identifikátor aktiva.
  • container_id -Identifikátor projektu.
  • column_name -Název sloupce, pro který spouštíte pravidla qulaity a analýzu.
  • check_id -Identifikátor pro kontrolu kvality dat.
  • number_of_occurences -Počet nalezených výskytů pro kontrolu kvality dat.
  • number_of_tested_records -Počet testovaných záznamů nalezených pro kontrolu kvality dat.
  • percent_occurences -procentní část výskytů.
  • score -Skóre bylo nalezeno po spuštění kontroly.
  • status -Aktuální stav problému.
  • ignored -Příznak k označení, zda aktuální problém se podílí na problému kvality dat.
  • Příkaz CREATE TABLE:

    CREATE TABLE IF NOT EXISTS dq_issues_for_asset_columns (
      issue_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      container_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      column_name character varying(256) COLLATE pg_catalog.default NOT NULL,
      asset_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      check_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      number_of_occurrences bigint NOT NULL DEFAULT 0,
      number_of_tested_records bigint NOT NULL DEFAULT 0,
      percent_occurrences double precision,
      score double precision,
      status character varying(16) COLLATE pg_catalog.default NOT NULL,
      ignored boolean NOT NULL,
      tech_start timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      tech_end timestamp(6) without time zone NOT NULL DEFAULT to_timestamp('9999-12-30' :: text, 'YYYY-MM-DD' :: text),
      ts_id timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      CONSTRAINT dq_issues_for_asset_columns_pkey PRIMARY KEY (issue_id, asset_id, container_id, column_name),
      CONSTRAINT fk_dq_issues_for_asset_columns_container_data_asset_columns_6 FOREIGN KEY (container_id, asset_id, column_name) REFERENCES container_data_asset_columns (container_id, asset_id, name) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE,
      CONSTRAINT fk_dq_issues_for_asset_columns_dq_checks_5 FOREIGN KEY (container_id, check_id) REFERENCES dq_checks (container_id, check_id) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE
    )
    
  • Příkaz CREATE TABLE:

    CREATE TABLE DQ_ISSUES_FOR_ASSET_COLUMNS (
      ISSUE_ID VARCHAR(36 OCTETS) NOT NULL,
      CONTAINER_ID VARCHAR(36 OCTETS) NOT NULL,
      COLUMN_NAME VARCHAR(256 OCTETS) NOT NULL,
      ASSET_ID VARCHAR(36 OCTETS) NOT NULL,
      CHECK_ID VARCHAR(36 OCTETS) NOT NULL,
      NUMBER_OF_OCCURRENCES BIGINT NOT NULL WITH DEFAULT 0,
      NUMBER_OF_TESTED_RECORDS BIGINT NOT NULL WITH DEFAULT 0,
      PERCENT_OCCURRENCES DOUBLE,
      SCORE DOUBLE,
      STATUS VARCHAR(16 OCTETS) NOT NULL,
      IGNORED BOOLEAN NOT NULL,
      TECH_START TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW BEGIN,
      TECH_END TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW END,
      TS_ID TIMESTAMP(12) NOT NULL GENERATED ALWAYS AS TRANSACTION START ID,
      PERIOD SYSTEM_TIME (TECH_START, TECH_END)
    ) IN USERSPACE1 ORGANIZE BY ROW;
    

    Příkazy ALTER TABLE:

    ALTER TABLE
      DQ_ISSUES_FOR_ASSET_COLUMNS
    ADD
      PRIMARY KEY (
        ISSUE_ID,
        ASSET_ID,
        CONTAINER_ID,
        COLUMN_NAME
      ) ENFORCED;
    
    ALTER TABLE
      DQ_ISSUES_FOR_ASSET_COLUMNS
    ADD
      CONSTRAINT FK_DQ_ISSUES_FOR_ASSET_COLUMNS_CONTAINER_DATA_ASSET_COLUMNS_6 FOREIGN KEY (CONTAINER_ID, ASSET_ID, COLUMN_NAME) REFERENCES CONTAINER_DATA_ASSET_COLUMNS (CONTAINER_ID, ASSET_ID, NAME) ON DELETE CASCADE ON UPDATE NO ACTION ENFORCED ENABLE QUERY OPTIMIZATION;
    
    ALTER TABLE
      DQ_ISSUES_FOR_ASSET_COLUMNS
    ADD
      CONSTRAINT FK_DQ_ISSUES_FOR_ASSET_COLUMNS_DQ_CHECKS_5 FOREIGN KEY (CHECK_ID, CONTAINER_ID) REFERENCES DQ_CHECKS (CHECK_ID, CONTAINER_ID) ON DELETE CASCADE ON UPDATE NO ACTION ENFORCED ENABLE QUERY OPTIMIZATION;
    

dq_issues_for_assets

Tato tabulka má následující sloupce:

  • issue_id -Identifikátor záležitosti aktiva.
  • container_id -Identifikátor projektu.
  • asset_id -Identifikátor aktiva.
  • check_id -Identifikátor pro kontrolu kvality dat.
  • number_of_occurences -Počet nalezených výskytů pro kontrolu kvality dat.
  • number_of_tested_records -Počet testovaných záznamů nalezených pro kontrolu kvality dat.
  • percent_occurences -procentní část výskytů.
  • score -Skóre bylo nalezeno po spuštění kontroly.
  • status -Aktuální stav problému.
  • ignored -Příznak k identifikaci, zda se aktuální problém podílí na problému kvality dat.
  • Příkaz CREATE TABLE:

    CREATE TABLE IF NOT EXISTS dq_issues_for_assets (
      issue_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      container_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      asset_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      check_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      number_of_occurrences bigint NOT NULL DEFAULT 0,
      number_of_tested_records bigint NOT NULL DEFAULT 0,
      percent_occurrences double precision,
      score double precision,
      status character varying(16) COLLATE pg_catalog.default NOT NULL,
      ignored boolean NOT NULL,
      tech_start timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      tech_end timestamp(6) without time zone NOT NULL DEFAULT to_timestamp('9999-12-30' :: text, 'YYYY-MM-DD' :: text),
      ts_id timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      CONSTRAINT dq_issues_for_assets_pkey PRIMARY KEY (issue_id, asset_id, container_id),
      CONSTRAINT fk_dq_issues_for_assets_container_data_assets_4 FOREIGN KEY (container_id, asset_id) REFERENCES container_data_assets (container_id, asset_id) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE,
      CONSTRAINT fk_dq_issues_for_assets_dq_checks_3 FOREIGN KEY (container_id, check_id) REFERENCES dq_checks (container_id, check_id) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE
    )
    
  • Příkaz CREATE TABLE:

    CREATE TABLE DQ_ISSUES_FOR_ASSETS (
      ISSUE_ID VARCHAR(36 OCTETS) NOT NULL,
      CONTAINER_ID VARCHAR(36 OCTETS) NOT NULL,
      ASSET_ID VARCHAR(36 OCTETS) NOT NULL,
      CHECK_ID VARCHAR(36 OCTETS) NOT NULL,
      NUMBER_OF_OCCURRENCES BIGINT NOT NULL WITH DEFAULT 0,
      NUMBER_OF_TESTED_RECORDS BIGINT NOT NULL WITH DEFAULT 0,
      PERCENT_OCCURRENCES DOUBLE,
      SCORE DOUBLE,
      STATUS VARCHAR(16 OCTETS) NOT NULL,
      IGNORED BOOLEAN NOT NULL,
      TECH_START TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW BEGIN,
      TECH_END TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW END,
      TS_ID TIMESTAMP(12) NOT NULL GENERATED ALWAYS AS TRANSACTION START ID,
      PERIOD SYSTEM_TIME (TECH_START, TECH_END)
    ) IN USERSPACE1 ORGANIZE BY ROW;
    

    Příkazy ALTER TABLE:

    ALTER TABLE
      DQ_ISSUES_FOR_ASSETS
    ADD
      PRIMARY KEY (ISSUE_ID, ASSET_ID, CONTAINER_ID) ENFORCED;
    
    ALTER TABLE
      DQ_ISSUES_FOR_ASSETS
    ADD
      CONSTRAINT FK_DQ_ISSUES_FOR_ASSETS_CONTAINER_DATA_ASSETS_4 FOREIGN KEY (CONTAINER_ID, ASSET_ID) REFERENCES CONTAINER_DATA_ASSETS (CONTAINER_ID, ASSET_ID) ON DELETE CASCADE ON UPDATE NO ACTION ENFORCED ENABLE QUERY OPTIMIZATION;
    
    ALTER TABLE
      DQ_ISSUES_FOR_ASSETS
    ADD
      CONSTRAINT FK_DQ_ISSUES_FOR_ASSETS_DQ_CHECKS_3 FOREIGN KEY (CHECK_ID, CONTAINER_ID) REFERENCES DQ_CHECKS (CHECK_ID, CONTAINER_ID) ON DELETE CASCADE ON UPDATE NO ACTION ENFORCED ENABLE QUERY OPTIMIZATION;
    

tabulka dq_checks

Tato tabulka má následující sloupce:

  • check_id -Identifikátor pro kontrolu kvality dat.
  • container_id -Identifikátor projektu.
  • dq_check_type -Typ kontroly kvality dat (může být profilling nebo data_rule).
  • dq_check_name -název kontroly kvality dat.
  • dq_dimension_id -Identifikátor dimenze kvality dat.
  • created_by -Uživatel, který vytvořil tuto kontrolu kvality dat.
  • created_on -Čas vytvoření kontroly kvality dat.
  • Příkaz CREATE TABLE:

    CREATE TABLE IF NOT EXISTS dq_checks (
      check_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      container_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      dq_check_type character varying(256) COLLATE pg_catalog.default NOT NULL,
      dq_check_name character varying(256) COLLATE pg_catalog.default NOT NULL,
      dq_dimension_id character varying(36) COLLATE pg_catalog.default NOT NULL,
      created_by character varying(256) COLLATE pg_catalog.default NOT NULL,
      created_on timestamp(6) without time zone NOT NULL,
      tech_start timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      tech_end timestamp(6) without time zone NOT NULL DEFAULT to_timestamp('9999-12-30' :: text, 'YYYY-MM-DD' :: text),
      ts_id timestamp(6) without time zone NOT NULL DEFAULT CURRENT_TIMESTAMP,
      CONSTRAINT dq_checks_pkey PRIMARY KEY (check_id, container_id),
      CONSTRAINT fk_dq_checks_containers_1 FOREIGN KEY (container_id) REFERENCES containers (container_id) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE,
      CONSTRAINT fk_dq_checks_dq_v4_dimensions_2 FOREIGN KEY (dq_dimension_id) REFERENCES dq_v4_dimensions (dimension_id) MATCH SIMPLE ON UPDATE NO ACTION ON DELETE CASCADE
    )
    
  • Příkaz CREATE TABLE:

     CREATE TABLE   DQ_CHECKS   (
     CHECK_ID  VARCHAR(36 OCTETS) NOT NULL , 
     CONTAINER_ID  VARCHAR(36 OCTETS) NOT NULL , 
     DQ_CHECK_TYPE  VARCHAR(256 OCTETS) NOT NULL , 
     DQ_CHECK_NAME  VARCHAR(256 OCTETS) NOT NULL , 
     DQ_DIMENSION_ID  VARCHAR(36 OCTETS) NOT NULL , 
     CREATED_BY  VARCHAR(256 OCTETS) NOT NULL , 
     CREATED_ON  TIMESTAMP(12) NOT NULL , 
     TECH_START  TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW BEGIN , 
     TECH_END  TIMESTAMP(12) NOT NULL IMPLICITLY HIDDEN GENERATED ALWAYS AS ROW END , 
     TS_ID  TIMESTAMP(12) NOT NULL GENERATED ALWAYS AS TRANSACTION START ID , 
     PERIOD SYSTEM_TIME ( TECH_START , TECH_END ) )   
     IN  USERSPACE1   
     ORGANIZE BY ROW;
    

    Příkazy ALTER TABLE:

     ALTER TABLE   DQ_CHECKS  
     ADD PRIMARY KEY
     ( CHECK_ID ,
     CONTAINER_ID )
     ENFORCED;
    
    ALTER TABLE   DQ_CHECKS  
    ADD CONSTRAINT  FK_DQ_CHECKS_CONTAINERS_1  FOREIGN KEY
    ( CONTAINER_ID )
    REFERENCES   CONTAINERS 
    ( CONTAINER_ID )
    ON DELETE CASCADE
    ON UPDATE NO ACTION
    ENFORCED
    ENABLE QUERY OPTIMIZATION;
    
    ALTER TABLE   DQ_CHECKS  
    ADD CONSTRAINT  FK_DQ_CHECKS_DQ_V4_DIMENSIONS_2  FOREIGN KEY
    ( DQ_DIMENSION_ID )
    REFERENCES   DQ_V4_DIMENSIONS 
    ( DIMENSION_ID )
    ON DELETE CASCADE
    ON UPDATE NO ACTION
    ENFORCED
    ENABLE QUERY OPTIMIZATION;
    

Tabulka dq_v4_dimensions

Tato tabulka obsahuje informace o dimenzích kvality pro dané pravidlo.

Tato tabulka má následující sloupce:

  • dimension_id -Identifikátor dimenze kvality dat.
  • name -název dimenze kvality dat.
  • description -Popis dimenze kvality dat.
  • Příkaz CREATE TABLE:

    create table dq_v4_dimensions(dimension_id varchar(128) not null,
    container_id varchar(36) not null,
    name varchar(256) not null,
    description varchar(256) not null,
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(dimension_id,
    container_id))
    

    Příkaz ALTER TABLE:

    alter table dq_v4_dimensions add constraint fk_dq_v4_dimensions_containers_1 foreign key (container_id) references containers(container_id) on
    delete
    	cascade on
    	update
    	no action
    

    Příkaz ALTER TABLE:

    ALTER TABLE IF EXISTS  dq_v4_dimensions
        OWNER to postgres;
    
    
  • Příkaz CREATE TABLE:

    create table dq_v4_dimensions(dimension_id varchar(128) not null,
    container_id varchar(36) not null,
    name varchar(256) not null,
    description varchar(256) not null,
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(dimension_id,
    container_id),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkaz ALTER TABLE:

    alter table dq_v4_dimensions add constraint fk_dq_v4_dimensions_containers_1 foreign key (container_id) references containers(container_id) on
    delete
    	cascade on
    	update
    	no action
    

tabulka dq_rule_definitions

Tato tabulka obsahuje skutečná metadata pro pravidlo kvality dat.

Tato tabulka má následující sloupce:

  • rule_definition_id -Identifikátor definice pravidla kvality dat.
  • container_id -Identifikátor katalogu nebo projektu.
  • expression -Výraz definice pravidla kvality dat.
  • dq_dimension_id -Identifikátor dimenze kvality dat.
  • name -název definice kvality dat.
  • Příkaz CREATE TABLE:

    create table dq_rule_definitions(rule_definition_id varchar(128) not null,
    container_id varchar(36) not null,
    expression text not null,
    dq_dimension_id varchar(128),
    name varchar(256) not null,
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(rule_definition_id))
    

    Příkazy ALTER TABLE:

    alter table dq_rule_definitions add constraint fk_dq_rule_definitions_containers_2 foreign key (container_id) references containers(container_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rule_definitions add constraint fk_dq_rule_definitions_dq_v4_dimensions_3 foreign key (dq_dimension_id,
    container_id) references dq_v4_dimensions(dimension_id,
    container_id) on
    delete
    	cascade on
    	update
    	no action
    
  • Příkaz CREATE TABLE:

    create table dq_rule_definitions(rule_definition_id varchar(128) not null,
    container_id varchar(36) not null,
    expression clob not null,
    dq_dimension_id varchar(128),
    name varchar(256) not null,
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(rule_definition_id),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkazy ALTER TABLE:

    alter table dq_rule_definitions add constraint fk_dq_rule_definitions_containers_2 foreign key (container_id) references containers(container_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rule_definitions add constraint fk_dq_rule_definitions_dq_v4_dimensions_3 foreign key (dq_dimension_id,
    container_id) references dq_v4_dimensions(dimension_id,
    container_id) on
    delete
    	cascade on
    	update
    	no action
    

tabulka dq_rules_defs

Tato tabulka obsahuje podrobnosti o vazbě mezi pravidlem a definicí, protože lze vytvořit více vazeb.

Tato tabulka má následující sloupce:

  • rule_id -Identifikátor pravidla kvality dat.
  • rule_definition_id -Identifikátor pro definici pravidla.
  • disambiguator -Číslo nejednoznačné dvojznačnosti.
  • Příkaz CREATE TABLE:

    create table dq_rules_defs(rule_id varchar(128) not null,
    rule_definition_id varchar(128) not null,
    disambiguator integer,
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(rule_id,
    rule_definition_id))
    

    Příkazy ALTER TABLE:

    alter table dq_rules_defs add constraint fk_dq_rules_defs_dq_rules_1 foreign key (rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rules_defs add constraint fk_dq_rules_defs_dq_rule_definitions_2 foreign key (rule_definition_id) references dq_rule_definitions(rule_definition_id) on
    delete
    	cascade on
    	update
    	no action
    
  • Příkaz CREATE TABLE:

    create table dq_rules_defs(rule_id varchar(128) not null,
    rule_definition_id varchar(128) not null,
    disambiguator integer,
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(rule_id,
    rule_definition_id),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkazy ALTER TABLE:

    alter table dq_rules_defs add constraint fk_dq_rules_defs_dq_rules_1 foreign key (rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rules_defs add constraint fk_dq_rules_defs_dq_rule_definitions_2 foreign key (rule_definition_id) references dq_rule_definitions(rule_definition_id) on
    delete
    	cascade on
    	update
    	no action
    

tabulka dq_rules

Tato tabulka obsahuje informace o pravidlech kvality dat.

Tato tabulka má následující sloupce:

  • rule_id -Identifikátor pravidla kvality dat.
  • container_id -Identifikátor katalogu nebo projektu.
  • dq_dimension_id -Identifikátor dimenze pravidel kvality dat.
  • name -název pravidla kvality dat.
  • output_asset_id -Identifikátor výstupního aktiva.
  • output_asset_container_id -Identifikátor výstupního katalogu nebo projektu.
  • Příkaz CREATE TABLE:

    create table dq_rules(rule_id varchar(128) not null,
    container_id varchar(36) not null,
    dq_dimension_id varchar(128),
    name varchar(256) not null,
    output_asset_id varchar(128),
    output_asset_container_id varchar(36),
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(rule_id))
    

    Příkaz ALTER TABLE:

    alter table dq_rules add constraint fk_dq_rules_dq_v4_dimensions_5 foreign key (dq_dimension_id,
    container_id) references dq_v4_dimensions(dimension_id,
    container_id) on
    delete
    	cascade on
    	update
    	no action
    
  • Příkaz CREATE TABLE:

    create table dq_rules(rule_id varchar(128) not null,
    container_id varchar(36) not null,
    dq_dimension_id varchar(128),
    name varchar(256) not null,
    output_asset_id varchar(128),
    output_asset_container_id varchar(36),
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(rule_id),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkaz ALTER TABLE:

    alter table dq_rules add constraint fk_dq_rules_dq_v4_dimensions_5 foreign key (dq_dimension_id,
    container_id) references dq_v4_dimensions(dimension_id,
    container_id) on
    delete
    	cascade on
    	update
    	no action
    

tabulka dq_rule_bindings

Tato tabulka obsahuje informace o vazbách pravidel kvality dat.

Tato tabulka má následující sloupce:

  • rule_id -Identifikátor pravidla kvality dat.
  • rule_definition_id -Identifikátor pro definici pravidla.
  • variable_name -Identifikátor proměnné, která se váže ke sloupci pro pravidlo kvality dat.
  • column_name -Název sloupce.
  • container_id -Identifikátor katalogu nebo projektu.
  • asset_id -Identifikátor aktiva.
  • Příkaz CREATE TABLE:

    create table dq_rule_bindings(rule_id varchar(128) not null,
    variable_name varchar(256) not null,
    column_name varchar(256) not null,
    container_id varchar(36) not null,
    asset_id varchar(128) not null,
    rule_definition_id varchar(128) default 'na' not null,
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(rule_id,
    rule_definition_id,
    variable_name,
    column_name))
    

    Příkazy ALTER TABLE:

    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_dq_rules_6 foreign key (rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_container_data_asset_columns_7 foreign key (container_id,
    asset_id,
    column_name) references container_data_asset_columns(container_id,
    asset_id,
    name) on
    delete
    	cascade on
    	update
    	no action 
    
    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_dq_rules_defs_3 foreign key (rule_id,
    rule_definition_id) references dq_rules_defs(rule_id,
    rule_definition_id) on
    delete
    	cascade on
    	update
    	no action
    
  • Příkaz CREATE TABLE:

    create table dq_rule_bindings(rule_id varchar(128) not null,
    variable_name varchar(256) not null,
    column_name varchar(256) not null,
    container_id varchar(36) not null,
    asset_id varchar(128) not null,
    rule_definition_id varchar(128) default 'na' not null,
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(rule_id,
    rule_definition_id,
    variable_name,
    column_name),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkazy ALTER TABLE:

    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_dq_rules_6 foreign key (rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_container_data_asset_columns_7 foreign key (container_id,
    asset_id,
    column_name) references container_data_asset_columns(container_id,
    asset_id,
    name) on
    delete
    	cascade on
    	update
    	no action
    
    alter table dq_rule_bindings add constraint fk_dq_rule_bindings_dq_rules_defs_3 foreign key (rule_id,
    rule_definition_id) references dq_rules_defs(rule_id,
    rule_definition_id) on
    delete
    	cascade on
    	update
    	no action
    

tabulka dq_rule_execution

Tato tabulka obsahuje informace o úloze pravidla pro pravidlo kvality dat.

Tato tabulka má následující sloupce:

  • dq_rule_id -Identifikátor pravidla kvality dat.
  • job_run_id -Identifikátor úlohy pro úlohu pravidla kvality dat.
  • start_time -počáteční čas úlohy pro úlohu pravidla kvality dat.
  • end_time -Koncový čas úlohy pro úlohu pravidla kvality dat.
  • nb_tested_rows -Počet testovaných řádků pro úlohu pravidla kvality dat.
  • nb_passing_rows -Počet řádků, které se předávají pro úlohu pravidla kvality dat.
  • nb_failing_rows -Počet selhávajících řádků pro úlohu pravidla kvality dat.
  • percent_passing_rows -Procentní část předání řádků pro úlohu pravidla kvality dat.
  • percent_failing_rows -Procentní část selhávajících řádků pro úlohu pravidla kvality dat.
  • sampling_used -Uvádí, zda se použije vzorkování pro pravidlo kvality dat.
  • sample_size -Velikost vzorkování pro pravidlo kvality dat.
  • sample_type -Typ vzorkování pro pravidlo kvality dat.
  • Příkaz CREATE TABLE:

    create table dq_rule_execution(dq_rule_id varchar(128) not null,
    job_run_id varchar(256) not null,
    start_time timestamp(6) not null,
    end_time timestamp(6) not null,
    nb_tested_rows bigint not null,
    nb_passing_rows bigint not null,
    nb_failing_rows bigint not null,
    percent_passing_rows float not null,
    percent_failing_rows float not null,
    sampling_used boolean not null,
    sample_size bigint,
    sample_type varchar(256),
    tech_start TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    tech_end TIMESTAMP(6) not null default to_timestamp('9999-12-30', 'YYYY-MM-DD'),
    ts_id TIMESTAMP(6) not null default CURRENT_TIMESTAMP,
    primary key(dq_rule_id,
    job_run_id))
    

    Příkaz ALTER TABLE:

    alter table dq_rule_execution add constraint fk_dq_rule_execution_dq_rules_8 foreign key (dq_rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    
  • Příkaz CREATE TABLE:

    create table dq_rule_execution(dq_rule_id varchar(128) not null,
    job_run_id varchar(256) not null,
    start_time timestamp(12) not null,
    end_time timestamp(12) not null,
    nb_tested_rows bigint not null,
    nb_passing_rows bigint not null,
    nb_failing_rows bigint not null,
    percent_passing_rows float not null,
    percent_failing_rows float not null,
    sampling_used boolean not null,
    sample_size bigint,
    sample_type varchar(256),
    tech_start TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row begin,
    tech_end TIMESTAMP(12) not null IMPLICITLY HIDDEN generated always as row
    end,
    ts_id TIMESTAMP(12) not null generated always as transaction start ID,
    primary key(dq_rule_id,
    job_run_id),
    period SYSTEM_TIME (tech_start,
    tech_end) ) ORGANIZE by row
    

    Příkaz ALTER TABLE:

    alter table dq_rule_execution add constraint fk_dq_rule_execution_dq_rules_8 foreign key (dq_rule_id) references dq_rules(rule_id) on
    delete
    	cascade on
    	update
    	no action
    

Další informace

Nadřízené téma: Vytváření sestav tabulky

Generative AI search and answer
These answers are generated by a large language model in watsonx.ai based on content from the product documentation. Learn more