Repository navigation
Fixes #1830 Merge v1.3.2-rc.1 into develop for mosip-data #403
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
62 commits
Select commit
Hold shift + click to select a range
83e0b7d
updated identity_schema_id & apptyp_code
GOKULRAJ136 61233e3
Merge pull request #323 from GOKULRAJ136/schema-1.3.x
ckm007 3eb0f3d
removed array of handle identity schema
dhanendra06 d55a5fe
[MOSIP-36481] added xlsx-to-csv.yml
Rakshithb1 73bd9f4
Merge pull request #330 from Rakshithb1/release-1.3.x
ckm007 471e01d
[MOSIP-36481] Updated README.md
Rakshithb1 6280cc9
Added converted CSV files
Rakshithb1 7ed1429
Merge pull request #331 from Rakshithb1/release-1.3.x
ckm007 9f1e1e8
Added converted CSV files
dhanendra06 9c0b0eb
Merge branch 'release-1.3.x' into mosip-32
ckm007 c190535
Merge pull request #326 from dhanendra06/mosip-32
ckm007 7796168
MOSIP-40766: Added all new templates in release-1.3.x
f98a703
MOSIP-40766: Added all new templates in release-1.3.x
f63a04c
MOSIP-40766: Added all new pms-revamp templates
ee79466
Added converted CSV files
41c9a56
Merge pull request #339 from SwethaKrish4/my1.3.x
dhanendra06 dc3c43f
MOSIP-42622: Added new FTM, APIKEY, SBI and Weekly summary templates
19ebe4d
Added converted CSV files
93f5ba6
Merge pull request #343 from SwethaKrish4/my1.3.x
ckm007 87c3a31
MOSIP-25895 : Added the proper value_json for the blood type dynamic …
GOKULRAJ136 15dd27e
Merge pull request #345 from chetankh239/MOSIP-42990-develop
dhanendra06 3e09df5
Cherry-picked CRVS schema from develop
chetankh239 b3a85a9
Merge pull request #349 from chetankh239/MOSIP-42990-release13x
dhanendra06 8157dc7
[MOSIP-43633] Added packetCreatedOn to identity schema for biometric …
ashok-ksharma b50c64d
Added converted CSV files
ashok-ksharma ba86bba
Blocklisted word changes [MOSIP-28207]
GOKULRAJ136 bef9b71
Merge pull request #350 from ashok-ksharma/MOSIP-43631_release-1.3.x
dhanendra06 6b2bcb0
Merge pull request #344 from GOKULRAJ136/blood-1.3.x
dhanendra06 ad4f1b3
Merge pull request #351 from GOKULRAJ136/block-black-13x
anushasunkada 157314b
Revert "[MOSIP-43633] Added packetCreatedOn to identity schema for bi…
ashok-ksharma 8164920
Merge pull request #353 from ashok-ksharma/revert-350-MOSIP-43631_rel…
dhanendra06 3baefaf
Add third-party notices to the project(mosip-data)
Rakshithasai123 f7075c0
Create MIT.txt
Rakshithasai123 6417dd2
Removed unnecessary data (#356)
anushasunkada 1d8e8ca
Create NOTICES.txt
rajapandi1234 c39f9ec
Update THIRD-PARTY-NOTICES.txt
Rakshithasai123 9b3d84b
Update MIT.txt
Rakshithasai123 968267d
Create NOTICES.txt
Rakshithasai123 b0d5e7f
Create MPL-2.0.txt
Rakshithasai123 6de6b76
Rename NOTICES.txt to NOTICE
Rakshithasai123 1541b61
Rename NOTICES.txt to NOTICE
rajapandi1234 037764d
Update README.md [MOSIP-44058] (#361)
GOKULRAJ136 395de2f
MOSIP-44100 : Review corrections (#360)
anushasunkada 322100b
Merge pull request #354 from Rakshithasai123/patch-1
Mahesh-Binayak aa7e367
Merge pull request #355 from Rakshithasai123/patch-2
Mahesh-Binayak 673249c
Merge pull request #358 from rajapandi1234/patch-1
Mahesh-Binayak e5a2032
Merge pull request #359 from Rakshithasai123/patch-4
Mahesh-Binayak 66d4143
Release 1.3.x (#373)
rajapandi1234 489bb61
[MOSIP-43633] packetCreatedOn added in identity_schema (release-1.3x)
NidhiKumari0201 5e87808
Added converted CSV files
NidhiKumari0201 ed265c1
Merge pull request #376 from NidhiKumari0201/MOSIP-43633-2026-Identit…
dhanendra06 eaa739e
Merge branch 'rc-latest' into dev-latest
GOKULRAJ136 148ac23
Create AGENTS.md
GOKULRAJ136 58f5d5a
Fix for masteruser not exists
GOKULRAJ136 db76fb7
changed DB_SERVERIP=localhost
GOKULRAJ136 9cb2e23
Update push-trigger.yml
GOKULRAJ136 2f66628
Update push-trigger.yml
GOKULRAJ136 22e6bc1
Update push-trigger.yml
GOKULRAJ136 08db638
Added DB_SCRIPTS_DIR=mosip_master
GOKULRAJ136 b1634f9
Update push-trigger.yml
GOKULRAJ136 02eceda
Update push-trigger.yml
GOKULRAJ136 d76514f
Merge branch 'develop' into dev-latest
GOKULRAJ136 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,72 @@ | ||
| # AGENTS.md | ||
|
|
||
| This file provides guidance to AI agents when working with code in this repository. | ||
|
|
||
| ## What This Repository Is | ||
|
|
||
| This is the **MOSIP Master Data Repository** — a data-only repo containing sample/sandbox master data for the [MOSIP identity platform](https://docs.mosip.io/1.2.0/id-lifecycle-management). It has no application code, no build system, and no test suite. Changes here feed directly into MOSIP database initialization and upgrades. | ||
|
|
||
| ## Data Layout | ||
|
|
||
| ``` | ||
| mosip_master/xlsx/ ← Canonical source: 37 Excel files (edit these) | ||
| mosip_master/csv/ ← Primary CSV source used by the masterdata-loader | ||
| mosip_master_csv/csv/ ← Auto-generated from xlsx via CI (do not edit manually) | ||
| mosip_master/data_upgrade/ ← Version-to-version delta migration scripts | ||
| ``` | ||
|
|
||
| **Key rule:** Only edit files in `mosip_master/xlsx/` or `mosip_master/csv/`. The `mosip_master_csv/csv/` directory is regenerated automatically by the `xlsx-to-csv` GitHub Actions workflow on every PR — manual edits there will be overwritten. | ||
|
|
||
| ## Workflows | ||
|
|
||
| ### xlsx-to-csv (`.github/workflows/xlsx-to-csv.yml`) | ||
| Triggers on PR open/sync or manual `workflow_dispatch`. Converts every `.xlsx` in `mosip_master/xlsx/` to CSV using `xlsx2csv` and commits the result into `mosip_master_csv/csv/` on the PR branch. Requires the `ACTION_PAT` secret. | ||
|
|
||
| To trigger manually: GitHub → Actions → "xlsx-to-csv" → Run workflow. | ||
|
|
||
| ### push-trigger (`.github/workflows/push-trigger.yml`) | ||
| Validates the full data load pipeline end-to-end: | ||
| 1. Spins up PostgreSQL 16 in Docker | ||
| 2. Runs `mosipdev/postgres-init:develop` to create the `mosip_master` schema | ||
| 3. Runs `mosipdev/masterdata-loader:develop` to load CSV data from this repo | ||
| 4. Checks for loader errors | ||
|
|
||
| This is the closest thing to a "test" for this repo. A passing run confirms the data is loadable. | ||
|
|
||
| ## Data Entities | ||
|
|
||
| The master data covers: | ||
|
|
||
| | Domain | Key files | | ||
| |---|---| | ||
| | Identity | `identity_schema`, `ui_spec`, `dynamic_field` | | ||
| | Templates | `template`, `template_type` | | ||
| | Devices | `device_master`, `device_spec`, `device_type` | | ||
| | Machines | `machine_master`, `machine_spec`, `machine_type` | | ||
| | Locations | `location`, `loc_hierarchy_list`, `zone`, `zone_user` | | ||
| | Registration | `registration_center`, `reg_center_type`, `reg_working_nonworking` | | ||
| | Documents | `valid_document`, `doc_category`, `doc_type`, `applicant_valid_document` | | ||
| | Lookup | `language`, `title`, `reason_list`, `blocklisted_words` | | ||
|
|
||
| **`identity_schema.csv`** is the most complex file — it embeds full JSON Schema Draft-07 definitions inside CSV cells. Each row is one schema version per language (e.g. `eng, 1001, 0.1, ...`). Schema ID 1001 = standard identity; 1002 = Mosip Identity for handle. | ||
|
|
||
| ## Data Upgrade Scripts | ||
|
|
||
| `mosip_master/data_upgrade/` contains **delta** migrations (not full datasets) between MOSIP versions: | ||
|
|
||
| - `1.1.5.5_to_1.2.0.1/` — Dynamic field format changed (array → object per language); UI spec split into separate table; new machine/template types | ||
| - `1.2.0.1_to_1.3.0/` — Template additions and updates only | ||
|
|
||
| **To run an upgrade:** | ||
| ```bash | ||
| cd mosip_master/data_upgrade/<version>/ | ||
| cp upgrade.properties upgrade.local.properties | ||
| # Fill in DB_SERVERIP, SU_USER_PWD, UPGRADE_DOMAIN_NAME, admin creds, language codes | ||
| bash upgrade.sh upgrade.local.properties | ||
| ``` | ||
|
|
||
| The Python helper scripts (`data-uploader.py`, `migration-ui_spec.py`, `migration-dynamicfield.py`) authenticate against the MOSIP Admin API and/or connect directly to PostgreSQL. They are invoked by `upgrade.sh` via `upgrade_commands.txt`. | ||
|
|
||
| ## Masterdata Reference | ||
|
|
||
| Full field definitions and valid values: https://docs.mosip.io/1.2.0/id-lifecycle-management/support-systems/administration/masterdata-guide | ||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| THIRD-PARTY-NOTICES | ||
|
|
||
| This project includes third-party packages that are distributed under various open-source licenses. Below is a list of packages and their associated licenses. | ||
|
|
||
| ================================================================================ | ||
| Package: actions/checkout | ||
| Version: 2.*.* | ||
| License: MIT License | ||
| Homepage: https://github.com/actions/checkout | ||
| ================================================================================ | ||
|
|
||
| ================================================================================ | ||
| Package: PostgreSQL (Docker Official Image) | ||
| Version: 16 | ||
| License: PostgreSQL License | ||
| Homepage: https://hub.docker.com/_/postgres | ||
| ================================================================================ | ||
|
|
||
| Full license texts and additional details for each of the above packages are available in the license/ directory of this repository. Please refer to those files or the original source of each package for complete legal terms and conditions. |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.