Changes between Version 2 and Version 3 of DataIntegrations


Ignore:
Timestamp:
03/16/15 16:28:40 (9 years ago)
Author:
Richard Bramley
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • DataIntegrations

    v2 v3  
    1111==== i2b2 Extract
    1212
    13 Status: Needs replacing
    14 
    15 Manual Export then copy files to [[i2b2 live server]] for importing using the [[i2b2 - Onyx import]].  This requires the {{{Next Patient Number}}}.
    16 
    17 ==== CiviCRM Extract
    18 
    19 Status: Deprecated when data collection complete
    20 
    21 Drupal cron job that runs on the [[CiviCRM live server]] and pulls data out of Onyx database and creates a patient record and BRICCS study enrolment in CiviCRM.
     13- **Status**: Working
     14- **Improvements Required**: Needs replacing
     15- **Source**: Onyx
     16- **Destination**: i2b2
     17- **Technology**: [[i2b2 - Onyx import]]
     18- **Description**: This requires the {{{Next Patient Number}}}.
     19
     20==== CiviCRM Extract
     21
     22- **Status**: Deprecated when data collection complete
     23- **Source**: Onyx
     24- **Destination**: CiviCRM
     25- **Technology**: Drupal Cron Job
     26- **Description**: Pulls data out of Onyx database and creates a patient record and BRICCS study enrolment in CiviCRM.
    2227
    2328=== Northampton BRICCS
    … …  
    2934==== i2b2 Extract
    3035
    31 Status: Needs replacing
    32 
    33 Manual Export then copy files to [[i2b2 live server]] for importing using the [[i2b2 - Onyx import]].  This requires the {{{Next Patient Number}}}.
    34 
    35 ==== CiviCRM Extract
    36 
    37 Status: Is this required
     36- **Status**: Working
     37- **Improvements Required**: Needs replacing
     38- **Source**: Onyx
     39- **Destination**: i2b2
     40- **Technology**: Drupal Cron Job
     41- **Description**: This requires the {{{Next Patient Number}}}.
     42
     43==== CiviCRM Extract
     44
     45- **Status**: Not Required
    3846
    3947=== Test BRICCS
    … …  
    4351==== i2b2 Extract
    4452
    45 Status: Needs replacing
    46 
    47 Manual Export then copy files to [[i2b2 test server]] for importing using the [[i2b2 - Onyx import]].  This requires the {{{Next Patient Number}}}.
     53- **Status**: Working
     54- **Improvements Required**: Needs replacing
     55- **Source**: Onyx
     56- **Destination**: i2b2
     57- **Technology**: [[i2b2 - Onyx import]]
     58- **Description**: This requires the {{{Next Patient Number}}}.
    4859
    4960==== i2b2 Extract (Version 2)
    5061
    51 Manual Export then copy files to [[i2b2 test server]] for importing using [[i2b2 - Mapped Importer]].
    52 
    53 The ontology for this has yet to be finalised and so the this is import has never been implemented on the [[i2b2 live server]].
     62- **Status**: Working
     63- **Improvements Required**: Needs replacing
     64- **Source**: Onyx
     65- **Destination**: i2b2
     66- **Technology**: [[i2b2 - Mapped Importer]]
     67- **Description**:
    5468
    5569== REDCap
    5670
     71=== SCAD (university Internet server)
     72
     73==== Data Collection: Ongoing
     74
     75Participants still register for the SCAD study and existing participants continue to complete additional questionnaires.
     76
     77==== CiviCRM Extract
     78
     79- **Status**: Working
     80- **Improvements Required**: OK for now
     81- **Source**: REDCap
     82- **Destination**: CiviCRM
     83- **Technology**: Manual
     84- **Description**: Spreadsheets are downloaded from REDCap and loaded into CiviCRM.
     85
     86=== BRICCS Leicester (hospital internal server)
     87
     88==== Data Collection: Ongoing
     89
     90==== CiviCRM Extract
     91
     92- **Status**: Required
     93- **Improvements Required**:
     94- **Source**: REDCap
     95- **Destination**: CiviCRM
     96- **Technology**: Drupal cron job
     97- **Description**: Load status of REDCap questionnaire into CiviCRM BRICCS enrolment.
     98
     99==== i2b2 Extract
     100
     101- **Status**: Partially written
     102- **Improvements Required**:
     103- **Source**: REDCap
     104- **Destination**: i2b2
     105- **Technology**: [[i2b2 - Mapped Importer]]
     106- **Description**: Load questionnaire data into i2b2.
     107
     108=== BRICCS External Sites (hospital N3 server)
     109
     110==== Sites
     111
     112- Kettering: recruiting
     113- Doncaster: recruiting
     114- Sheffield: recruiting
     115- Lincoln: recruiting
     116- Grantham: recruiting
     117- Chesterfield: recruiting
     118- Northampton: planned
     119- Royal Free Hospital: planned (might be DREAM)
     120
     121==== CiviCRM Extract
     122
     123- **Status**: Not Required
     124
     125==== i2b2 Extract
     126
     127- **Status**: Planned when completed for BRICCS Leicester
     128- **Improvements Required**:
     129- **Source**: REDCap
     130- **Destination**: i2b2
     131- **Technology**: [[i2b2 - Mapped Importer]]
     132- **Description**: Load questionnaire data.
     133
    57134== CiviCRM
    58135
     136=== Common
     137
     138==== HSCIC Practice Import
     139
     140- **Status**: Working
     141- **Improvements Required**: None
     142- **Source**: HSCIC practice details files
     143- **Destination**: CiviCRM practice details
     144- **Technology**: Drupal cron job
     145
     146=== GENVASC
     147
     148==== Data Collection: Ongoing
     149
     150Recruitment ongoing.  Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.
     151
     152==== ICE Message Import
     153
     154- **Status**: Working
     155- **Improvements Required**: Amend the processing of ICE messages to require fewer manual amendments by the administrators.
     156- **Source**: Server: UHLSQLPRIME01\UHLBRICCSDB Database: genvasc-ice
     157- **Destination**: CiviCRM
     158- **Technology**: PHP MS SQL Server connection
     159
     160==== i2b2 Extract Available Patients
     161
     162- **Status**: Working
     163- **Improvements Required**: None
     164- **Source**: CiviCRM
     165- **Destination**: i2b2
     166- **Technology**: [[i2b2 - Mapped Importer]]
     167- **Description**: Load participant and consent information.
     168
     169==== i2b2 Delete Withdrawn Patients
     170
     171- **Status**: Working
     172- **Improvements Required**: None
     173- **Source**: CiviCRM
     174- **Destination**: i2b2
     175- **Technology**: [[i2b2 - Mapped Importer]]
     176- **Description**: Delete participants who have withdrawn.
     177
     178===== Improvements Required
     179
     180Check that it also deletes excluded participants.
     181
     182=== BRICCS
     183
     184==== Data Collection: Ongoing
     185
     186Recruitment ongoing.  Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.
     187
     188==== i2b2 Delete Withdrawn Patients
     189
     190- **Status**: Required
     191- **Improvements Required**: None
     192- **Source**: CiviCRM
     193- **Destination**: i2b2
     194- **Technology**: [[i2b2 - Mapped Importer]]
     195- **Description**: Delete participants who have withdrawn.
     196
     197=== NIHR Bio-Resource
     198
     199==== Data Collection: Ongoing
     200
     201Recruitment ongoing.  Will need to be able to continue amending participants records after recruitment is complete to track withdrawals.
     202
     203==== i2b2 Extract Available Patients
     204
     205- **Status**: Working
     206- **Improvements Required**: None
     207- **Source**: CiviCRM
     208- **Destination**: i2b2
     209- **Technology**: [[i2b2 - Mapped Importer]]
     210- **Description**: Load participant and consent information.
     211
     212==== i2b2 Delete Withdrawn Patients
     213
     214- **Status**: Required
     215- **Improvements Required**: None
     216- **Source**: CiviCRM
     217- **Destination**: i2b2
     218- **Technology**: [[i2b2 - Mapped Importer]]
     219- **Description**: Delete participants who have withdrawn.
     220
    59221== CaTissue
    60222
     223=== GENVASC
     224
     225==== Data Collection: Ongoing
     226
     227==== Participant Reconciliation
     228
     229- **Status**: Required
     230- **Improvements Required**: None
     231- **Source**: CiviCRM & CaTissue
     232- **Destination**: Report
     233- **Technology**: Drupal cron job?
     234- **Description**: Reconcile the GPt numbers in CaTissue with those in CiviCRM to check that all samples have enrolments and all enrolments have samples.
     235
     236=== BRICCS
     237
     238==== Data Collection: Ongoing
     239
     240==== Participant Reconciliation
     241
     242- **Status**: Required
     243- **Improvements Required**: None
     244- **Source**: CiviCRM & CaTissue
     245- **Destination**: Report
     246- **Technology**: Drupal cron job?
     247- **Description**: Reconcile the BPt numbers in CaTissue with those in CiviCRM to check that all samples have enrolments and all enrolments have samples.
     248
    61249== i2b2
     250
     251=== GENVASC
     252
     253==== Data Collection: Ongoing
     254
     255==== GEM Primary Care Data
     256
     257- **Status**: Particially Written
     258- **Improvements Required**: Need meeting with GEM
     259- **Source**: GEM SystemOne and EMIS data warehouses
     260- **Destination**: i2b2
     261- **Technology**: SSIS
     262- **Description**: Import primary care data from GEM
     263
     264==== PATS Data
     265
     266- **Status**: Working
     267- **Improvements Required**: None
     268- **Source**: UHL data warehouses
     269- **Destination**: i2b2
     270- **Technology**: SSIS
     271- **Description**: Import hospital audit data
     272
     273==== PMI Data
     274
     275- **Status**: Working
     276- **Improvements Required**: None
     277- **Source**: UHL data warehouses
     278- **Destination**: i2b2
     279- **Technology**: SSIS
     280- **Description**: Import hospital PMI data
     281
     282==== Hospital HES Data
     283
     284- **Status**: Partially Written
     285- **Improvements Required**: None
     286- **Source**: UHL data warehouses
     287- **Destination**: i2b2
     288- **Technology**: SSIS
     289- **Description**: Import hospital HES data
     290
     291==== Hospital Discharge Letters Data
     292
     293- **Status**: Partially Written
     294- **Improvements Required**: None
     295- **Source**: UHL data warehouses
     296- **Destination**: i2b2
     297- **Technology**: SSIS
     298- **Description**: Import hospital discharge data
     299
     300==== National HES Data
     301
     302- **Status**: Required
     303- **Improvements Required**: None
     304- **Source**: HSCIC DARS
     305- **Destination**: i2b2
     306- **Technology**: ?
     307- **Description**: Import national HES data
     308
     309==== National ONS Cause of Death Data
     310
     311- **Status**: Required
     312- **Improvements Required**: None
     313- **Source**: HSCIC DARS
     314- **Destination**: i2b2
     315- **Technology**: ?
     316- **Description**: Import national ONS Cause of Death data
     317
     318=== BRICCS
     319
     320==== Data Collection: Ongoing
     321
     322==== PATS Data
     323
     324- **Status**: Working
     325- **Improvements Required**: None
     326- **Source**: UHL data warehouses
     327- **Destination**: i2b2
     328- **Technology**: SSIS
     329- **Description**: Import hospital audit data
     330
     331==== PMI Data
     332
     333- **Status**: Working
     334- **Improvements Required**: None
     335- **Source**: UHL data warehouses
     336- **Destination**: i2b2
     337- **Technology**: SSIS
     338- **Description**: Import hospital PMI data
     339
     340==== Hospital HES Data
     341
     342- **Status**: Partially Written
     343- **Improvements Required**: None
     344- **Source**: UHL data warehouses
     345- **Destination**: i2b2
     346- **Technology**: SSIS
     347- **Description**: Import hospital HES data
     348
     349==== Hospital Discharge Letters Data
     350
     351- **Status**: Partially Written
     352- **Improvements Required**: None
     353- **Source**: UHL data warehouses
     354- **Destination**: i2b2
     355- **Technology**: SSIS
     356- **Description**: Import hospital discharge data
     357