Methodology

What It Is

The Justice Snapshot is a rapid justice assessment, designed to enable local teams deployed on the ground to collect data across the justice system. It engages with justice stakeholders and national authorities to produce a common evidence base for planning short, medium and long term reforms in the justice system, while providing a monitoring and evaluation framework to measure progress.

Experience shows that justice data may be scattered, but they exist. The Justice Snapshot comprises data collection within an accessible and interactive website that anchors system stabilization in reliable baseline data and encourages national institutions to invest in data collection to inform and streamline their priorities for programming.

The data are collected for a 12 month period against an agreed cut-off date. In this Justice (Pilot) Snapshot of Lao PDR, the data are for the year 2025 (from 1 January to 31 December). The Lao PDR Pilot focuses on key institutions related to the delivery of Legal Aid in two Provinces - Luang Prabang and Khammouane.

What It Does

The Justice Snapshot sets out to contextualise the environment within which justice operates. It depicts the way the justice system is designed to function in law; the flow of cases through the criminal and civil courts; justice system governance; and budget and expenditure.

Importantly, it leaves national authorities and development partners with greater analytical and monitoring capacity than when it began. By embedding information collected, within a website, the Snapshot can be updated to establish an increasingly accurate repository of data to inform both justice policy and the strategic interventions needed going forward.

The Lao PDR Pilot demonstrates the power of collecting, analysing and visualising data through geography as a starting point for harnessing validated administrative data in helping determine policy priorities.

The Justice Snapshot, like the Justice Audit, does not rank countries, nor score institutions or departments. Instead, it enjoins justice institutions to present an empirical account of system resources, processes and practices that allow the data to speak directly to the stakeholder. Justice Audits and Justice Snapshots have been conducted elsewhere at the invitations of the governments and stakeholders concerned in Afghanistan, Malaysia, Bangladesh, United States of America, South Sudan, South Central Somalia, Somaliland, Ethiopia and Sri Lanka.

Why It Works

It provides context, bringing together information about the justice services provided within a governance framework. These data may better inform responses to provide justice and other social services where they are needed most.

It measures impact, compiling data by institution or department from the ground up, and so helping to identify weaknesses or gaps in personnel, infrastructure and material resources. This enables state planners and development partners to assess and address strategic building, equipping, and training needs and to monitor and evaluate incremental progress over time so as to scale up what works and remedy what does not.

It is accessible, quick and transparent, applying a tried and tested methodology and using interactive visualizations to accentuate nuances in data, instead of a static report; while signalling discrepancies through data notes and making all source data available to users.

It is collaborative and transferable, engaging the justice institutions from the beginning in collecting and analyzing their own data to stabilize justice system operations. In this Lao PDR Pilot, the Ministry of Justice is the lead institution and decided to focus on Provincial and District Offices of Justice, and the Notary, Legal Aid and Judgement Enforcement Departments, as well as the Lao Bar Association. The Justice Snapshot is objective and apolitical, generating a series of data-driven accounts of the functioning of the system, giving national authorities the tools to inform their interventions, rather than policy prescriptions.

How It Works

The data visualised here have been collected from each District Office of Justice, with respect to the Departments of Legal Aid, Judgement Enforcement, and Notary, as well as from the Provincial Office of Justice, and the Lao Bar Association in both Luang Prabang and Khammouane Provinces.

The process of data collection was developed with the Ministry of Justice and relevant Departments and implemented with their consent and participation.

The data are owned by the Ministry of Justice and are shared for purposes of combining them on the same site.

Data collected in Justice Snapshots comprise a breakdown of resources, infrastructure and statistics of the services provided and matters addressed. The aim is that all data are, in so far as it is possible, disaggregated by age, gender and physical disability. All data are anonymised and Personally Identifiable Information (PII) removed.

The data in this Snapshot are self-reported. They are taken from annual performance reports prepared by the MOJ and each department and further supplemented from questionnaires (supplementary data forms) agreed with the departments and Lao Bar Association and distributed to the individual facilities in the districts.

The supplementary data forms, once collected, are cleaned of obvious errors. Any gaps in data are indicated "NO DATA" unless the data show, for instance, 0 vehicles. Where the accuracy of data cannot be verified, or require further explanation, these are indicated in the "Data Note" box. The cleaned data sheets appear by institution in the Baseline Data as these are the data visualised throughout the Justice Snapshot.

Note: the data captured will never be 100% accurate. Gaps and errors will occur especially in this Pilot Justice Snapshot as those working on the frontline of the justice system do not necessarily collect and analyse data systematically and especially not on a disaggregated basis. However, data collection and accuracy will improve over time and as systems are embedded within each institution. The value of data also increases for practitioners as they see it being used.

The data are then organized and forwarded to a team of data visualisation experts who design the visualizations based on the data and populate the visuals with the data. Both the Justice Audit and Justice Snapshot are designed to be living tools rather than one-off reports. The purpose is to capture data over time and identify trends and so monitor more closely what works, and so scale up, and what does not, and so recalibrate or jettison.

How Data May Be Updated And Sustained

The engagement with key institutional actors at the outset is not just a courtesy. The methodology aims to maximize the participation of all actors and encourage them to invest in their own data collection better to inform policy for the sector as a whole and leverage more resources for their own institution. From the moment it is formed, the Justice Snapshot Technical Committee (JSTC) of the Ministry of Justice takes ownership of the process, and so is central to this approach.

Following this Justice Snapshot, it is intended that the Justice Snapshot Technical Committee members encourage their respective departments to collect disaggregated data, at regular intervals, using standardised data collection sheets. These data will be reported in line with existing procedures up the chain and to an information management unit (IMU) to conduct successive Justice Snapshots going forward at 1-2 year intervals to monitor change over time.

Each Justice Snapshot follows a seven-stage process:

1. Planning
2. Framing
3. Collecting
4. Interrogating
5. Designing
6. Validating
7. Transferring

1. Planning

A process of consultations with government and institutional stakeholders was undertaken through a scoping mission coordinated with the Ministry of Justice with an international consultant (team leader). This scoping mission presented options for the Ministry and its partner GIZ as to possible next steps. The option of a limited Pilot Snapshot focusing on two provinces and concentrating on legal aid issues was preferred, and the implementation proceeded on that basis. The Justice Snapshot Technical Committee (JSTC) was convened to begin the process.

2. Framing

Field work started with a Data Integrity Check to determine how each institution generates, stores and communicates their data up the institutional chain. Supplementary data forms were created and refined by each institution, to capture the reality of how the target departments functioned at their most local level.

The forms were structured around key categories: material resources, human resources, and physical infrastructure. Gender and disability disaggregation was integrated directly into the forms, ensuring that disparities and gaps could be identified across institutional branches. The forms were then disseminated across the institutional landscape.

3. Data Collection

The team collected national data from institutional annual performance reports. The supplementary data forms were completed by the departments at both Provincial level and District level, gathering data from each of 12 District Offices of Justice in Luang Prabang and 10 in Khammouane.

4. Interrogation

The data sheets submitted by the departments formed the basis for the next stage of the process: the interrogation and cleaning of all received material.

4.1 Application of the Four-Eyes Principle

Each individual form was reviewed using the Four Eyes principle, meaning two sets of eyes on each form. Forms were checked for missing information, unclear entries, inconsistencies and errors. Forms requiring correction were returned to the Ministry of Justice focal point who liaised with each relevant District or Provincial Office to clarify, update, and resubmit the form. In a number of cases, the data cleaning team made assumptions based on the data entries, for instance where a "-" was entered or the data value was left blank, a "0" was inserted in its place or "NO DATA". The data once cleaned was entered in the FINAL column and uploaded onto a consolidated data sheet for that institution, which can be viewed in the Baseline Data.

4.2 Treatment of Missing or Unreliable Data

Where fields were left blank or where the reviewers determined that the information provided could not be relied upon, the value "NO DATA" was entered.

4.3 Consolidation and Organisation of the Data

After the EYES 1 and EYES 2 reviews were complete, all processed documents were transferred into a dedicated "Consolidated" folder. Within this folder, data were organised by Office and Department, with individual files created for each body to allow for traceability and to mirror the architecture of the final dataset.

Forms were then transcribed into structured spreadsheets, maintaining a consistent sequence of fields across institutions. The team applied a unified coding system to harmonise terminology and ensure comparability between institutions whose forms were formatted differently. This step was essential for establishing a coherent dataset capable of being analysed and, later, visualized.

The consolidation stage thus served two purposes:

1. To gather the data into one structured repository.
2. To translate any institution-specific reporting styles into a standardised format suitable for cross-institutional analysis.

5. Designing

The visualization of data, often dense and complex, ensures the viewer can stay in the blue water observing the whole system, while at the same time being able to dive down into the weeds to see what is happening there. The viewer is urged to refer back to the Baseline data, the "weeds", to check the view being offered. Data Notes either come from the institutions themselves, or are entered by the team to shed light on the data shown.

The data collected, national and supplementary, were then analysed to identify gaps or blockages and therefore to identify priority areas of need, action, or policy review.

6. Validating

The data were validated in advance of the consolidated data sets being finalised, through the Ministry focal point in consultation with individual offices, and further, at a dedicated meeting in the Ministry of Justice where all departments were represented.

7. Transferring

The website is launched internally with the Ministry of Justice and Cabinet Division, as well as showcased at the Lao PDR Rule of Law Sector Working Group annual meeting. Ownership of data remains with the Ministry and relevant departments and can be used as the basis for further analysis and forward planning.