Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
83e0b7d
updated identity_schema_id & apptyp_code
GOKULRAJ136 Oct 22, 2024
61233e3
Merge pull request #323 from GOKULRAJ136/schema-1.3.x
ckm007 Oct 22, 2024
3eb0f3d
removed array of handle identity schema
dhanendra06 Oct 28, 2024
d55a5fe
[MOSIP-36481] added xlsx-to-csv.yml
Rakshithb1 Nov 6, 2024
73bd9f4
Merge pull request #330 from Rakshithb1/release-1.3.x
ckm007 Nov 6, 2024
471e01d
[MOSIP-36481] Updated README.md
Rakshithb1 Nov 6, 2024
6280cc9
Added converted CSV files
Rakshithb1 Nov 6, 2024
7ed1429
Merge pull request #331 from Rakshithb1/release-1.3.x
ckm007 Nov 6, 2024
9f1e1e8
Added converted CSV files
dhanendra06 Nov 6, 2024
9c0b0eb
Merge branch 'release-1.3.x' into mosip-32
ckm007 Nov 6, 2024
c190535
Merge pull request #326 from dhanendra06/mosip-32
ckm007 Nov 11, 2024
7796168
MOSIP-40766: Added all new templates in release-1.3.x
May 26, 2025
f98a703
MOSIP-40766: Added all new templates in release-1.3.x
May 28, 2025
f63a04c
MOSIP-40766: Added all new pms-revamp templates
Jun 3, 2025
ee79466
Added converted CSV files
Jun 3, 2025
41c9a56
Merge pull request #339 from SwethaKrish4/my1.3.x
dhanendra06 Jun 4, 2025
dc3c43f
MOSIP-42622: Added new FTM, APIKEY, SBI and Weekly summary templates
Aug 7, 2025
19ebe4d
Added converted CSV files
Aug 7, 2025
93f5ba6
Merge pull request #343 from SwethaKrish4/my1.3.x
ckm007 Aug 8, 2025
87c3a31
MOSIP-25895 : Added the proper value_json for the blood type dynamic …
GOKULRAJ136 Sep 22, 2025
15dd27e
Merge pull request #345 from chetankh239/MOSIP-42990-develop
dhanendra06 Oct 10, 2025
3e09df5
Cherry-picked CRVS schema from develop
chetankh239 Nov 14, 2025
b3a85a9
Merge pull request #349 from chetankh239/MOSIP-42990-release13x
dhanendra06 Nov 14, 2025
8157dc7
[MOSIP-43633] Added packetCreatedOn to identity schema for biometric …
ashok-ksharma Nov 14, 2025
b50c64d
Added converted CSV files
ashok-ksharma Nov 14, 2025
ba86bba
Blocklisted word changes [MOSIP-28207]
GOKULRAJ136 Nov 14, 2025
bef9b71
Merge pull request #350 from ashok-ksharma/MOSIP-43631_release-1.3.x
dhanendra06 Nov 14, 2025
6b2bcb0
Merge pull request #344 from GOKULRAJ136/blood-1.3.x
dhanendra06 Nov 14, 2025
ad4f1b3
Merge pull request #351 from GOKULRAJ136/block-black-13x
anushasunkada Nov 17, 2025
157314b
Revert "[MOSIP-43633] Added packetCreatedOn to identity schema for bi…
ashok-ksharma Nov 21, 2025
8164920
Merge pull request #353 from ashok-ksharma/revert-350-MOSIP-43631_rel…
dhanendra06 Nov 22, 2025
3baefaf
Add third-party notices to the project(mosip-data)
Rakshithasai123 Nov 26, 2025
f7075c0
Create MIT.txt
Rakshithasai123 Nov 28, 2025
6417dd2
Removed unnecessary data (#356)
anushasunkada Nov 30, 2025
1d8e8ca
Create NOTICES.txt
rajapandi1234 Dec 2, 2025
c39f9ec
Update THIRD-PARTY-NOTICES.txt
Rakshithasai123 Dec 3, 2025
9b3d84b
Update MIT.txt
Rakshithasai123 Dec 6, 2025
968267d
Create NOTICES.txt
Rakshithasai123 Dec 6, 2025
b0d5e7f
Create MPL-2.0.txt
Rakshithasai123 Dec 8, 2025
6de6b76
Rename NOTICES.txt to NOTICE
Rakshithasai123 Dec 9, 2025
1541b61
Rename NOTICES.txt to NOTICE
rajapandi1234 Dec 9, 2025
037764d
Update README.md [MOSIP-44058] (#361)
GOKULRAJ136 Dec 16, 2025
395de2f
MOSIP-44100 : Review corrections (#360)
anushasunkada Dec 19, 2025
322100b
Merge pull request #354 from Rakshithasai123/patch-1
Mahesh-Binayak Dec 20, 2025
aa7e367
Merge pull request #355 from Rakshithasai123/patch-2
Mahesh-Binayak Dec 20, 2025
673249c
Merge pull request #358 from rajapandi1234/patch-1
Mahesh-Binayak Dec 20, 2025
e5a2032
Merge pull request #359 from Rakshithasai123/patch-4
Mahesh-Binayak Dec 20, 2025
66d4143
Release 1.3.x (#373)
rajapandi1234 Jan 14, 2026
489bb61
[MOSIP-43633] packetCreatedOn added in identity_schema (release-1.3x)
NidhiKumari0201 Jan 14, 2026
5e87808
Added converted CSV files
NidhiKumari0201 Jan 14, 2026
ed265c1
Merge pull request #376 from NidhiKumari0201/MOSIP-43633-2026-Identit…
dhanendra06 Jan 14, 2026
eaa739e
Merge branch 'rc-latest' into dev-latest
GOKULRAJ136 Jun 8, 2026
148ac23
Create AGENTS.md
GOKULRAJ136 Jun 8, 2026
58f5d5a
Fix for masteruser not exists
GOKULRAJ136 Jun 8, 2026
db76fb7
changed DB_SERVERIP=localhost
GOKULRAJ136 Jun 8, 2026
9cb2e23
Update push-trigger.yml
GOKULRAJ136 Jun 8, 2026
2f66628
Update push-trigger.yml
GOKULRAJ136 Jun 8, 2026
22e6bc1
Update push-trigger.yml
GOKULRAJ136 Jun 8, 2026
08db638
Added DB_SCRIPTS_DIR=mosip_master
GOKULRAJ136 Jun 8, 2026
b1634f9
Update push-trigger.yml
GOKULRAJ136 Jun 8, 2026
02eceda
Update push-trigger.yml
GOKULRAJ136 Jun 8, 2026
d76514f
Merge branch 'develop' into dev-latest
GOKULRAJ136 Jun 8, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 72 additions & 0 deletions AGENTS.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,72 @@
# AGENTS.md

This file provides guidance to AI agents when working with code in this repository.

## What This Repository Is

This is the **MOSIP Master Data Repository** — a data-only repo containing sample/sandbox master data for the [MOSIP identity platform](https://docs.mosip.io/1.2.0/id-lifecycle-management). It has no application code, no build system, and no test suite. Changes here feed directly into MOSIP database initialization and upgrades.

## Data Layout

```
mosip_master/xlsx/ ← Canonical source: 37 Excel files (edit these)
mosip_master/csv/ ← Primary CSV source used by the masterdata-loader
mosip_master_csv/csv/ ← Auto-generated from xlsx via CI (do not edit manually)
mosip_master/data_upgrade/ ← Version-to-version delta migration scripts
```
Comment thread
GOKULRAJ136 marked this conversation as resolved.
Resolved

**Key rule:** Only edit files in `mosip_master/xlsx/` or `mosip_master/csv/`. The `mosip_master_csv/csv/` directory is regenerated automatically by the `xlsx-to-csv` GitHub Actions workflow on every PR — manual edits there will be overwritten.

## Workflows

### xlsx-to-csv (`.github/workflows/xlsx-to-csv.yml`)
Triggers on PR open/sync or manual `workflow_dispatch`. Converts every `.xlsx` in `mosip_master/xlsx/` to CSV using `xlsx2csv` and commits the result into `mosip_master_csv/csv/` on the PR branch. Requires the `ACTION_PAT` secret.

To trigger manually: GitHub → Actions → "xlsx-to-csv" → Run workflow.

### push-trigger (`.github/workflows/push-trigger.yml`)
Validates the full data load pipeline end-to-end:
1. Spins up PostgreSQL 16 in Docker
2. Runs `mosipdev/postgres-init:develop` to create the `mosip_master` schema
3. Runs `mosipdev/masterdata-loader:develop` to load CSV data from this repo
4. Checks for loader errors

This is the closest thing to a "test" for this repo. A passing run confirms the data is loadable.

## Data Entities

The master data covers:

| Domain | Key files |
|---|---|
| Identity | `identity_schema`, `ui_spec`, `dynamic_field` |
| Templates | `template`, `template_type` |
| Devices | `device_master`, `device_spec`, `device_type` |
| Machines | `machine_master`, `machine_spec`, `machine_type` |
| Locations | `location`, `loc_hierarchy_list`, `zone`, `zone_user` |
| Registration | `registration_center`, `reg_center_type`, `reg_working_nonworking` |
| Documents | `valid_document`, `doc_category`, `doc_type`, `applicant_valid_document` |
| Lookup | `language`, `title`, `reason_list`, `blocklisted_words` |

**`identity_schema.csv`** is the most complex file — it embeds full JSON Schema Draft-07 definitions inside CSV cells. Each row is one schema version per language (e.g. `eng, 1001, 0.1, ...`). Schema ID 1001 = standard identity; 1002 = Mosip Identity for handle.

## Data Upgrade Scripts

`mosip_master/data_upgrade/` contains **delta** migrations (not full datasets) between MOSIP versions:

- `1.1.5.5_to_1.2.0.1/` — Dynamic field format changed (array → object per language); UI spec split into separate table; new machine/template types
- `1.2.0.1_to_1.3.0/` — Template additions and updates only

**To run an upgrade:**
```bash
cd mosip_master/data_upgrade/<version>/
cp upgrade.properties upgrade.local.properties
# Fill in DB_SERVERIP, SU_USER_PWD, UPGRADE_DOMAIN_NAME, admin creds, language codes
bash upgrade.sh upgrade.local.properties
```

The Python helper scripts (`data-uploader.py`, `migration-ui_spec.py`, `migration-dynamicfield.py`) authenticate against the MOSIP Admin API and/or connect directly to PostgreSQL. They are invoked by `upgrade.sh` via `upgrade_commands.txt`.

## Masterdata Reference

Full field definitions and valid values: https://docs.mosip.io/1.2.0/id-lifecycle-management/support-systems/administration/masterdata-guide
13 changes: 12 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,18 @@
# Sample Data

## Overview
This repo contains data that is uploaded into MOSIP during [sandbox installation](https://docs.mosip.io/1.2.0/deployment/sandbox-deployment). The data needs to be reviewed and modified for a country specific deployment. Refer to [Masterdata Guide](https://docs.mosip.io/1.2.0/deployment/masterdata-guide).
This repo contains data that is uploaded into MOSIP during [sandbox installation](https://docs.mosip.io/1.2.0/setup/deploymentnew/getting-started#mosip-installations). The data needs to be reviewed and modified for a country specific deployment. Refer to [Masterdata Guide](https://docs.mosip.io/1.2.0/id-lifecycle-management/support-systems/administration/masterdata-guide).

## For Build and Run
Data initialization is performed through the **Master Data Loader** as part of the [postgres-init](https://github.com/mosip/postgres-init/tree/release-1.3.x) repository.

## Contribution & Community

• To learn how you can contribute code to this application, [click here](https://docs.mosip.io/1.2.0/community/code-contributions).

• If you have questions or encounter issues, visit the [MOSIP Community](https://community.mosip.io/) for support.

• For any GitHub issues: [Report here](https://github.com/mosip/mosip-data/issues)

## License
This project is licensed under the terms of [Mozilla Public License 2.0](LICENSE).
Expand Down
19 changes: 19 additions & 0 deletions THIRD-PARTY-NOTICES.txt
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
THIRD-PARTY-NOTICES

This project includes third-party packages that are distributed under various open-source licenses. Below is a list of packages and their associated licenses.

================================================================================
Package: actions/checkout
Version: 2.*.*
License: MIT License
Homepage: https://github.com/actions/checkout
================================================================================

================================================================================
Package: PostgreSQL (Docker Official Image)
Version: 16
License: PostgreSQL License
Homepage: https://hub.docker.com/_/postgres
================================================================================

Full license texts and additional details for each of the above packages are available in the license/ directory of this repository. Please refer to those files or the original source of each package for complete legal terms and conditions.
Loading
Loading