Page tree
Skip to end of metadata
Go to start of metadata

SSDM datamodel upgrade

 

  • internal meetings on the datamodel changes implied by the change of structure from single database (GhoSST) to SSHADE database infrastructure
    • discussion on how to separate the common databases (common data: fundamental data + general data) and the lab databases (partner data)
    • discussed: experimentalists, instruments, samples & matters
    • addition of a 'database' table => Done with all necessary DOI keywords
    • ...

SSHADE infrastructure implementation

Software structure

Database structure

  • Software implementation
    • Use of PostgreSQL schemas (OK - completed)
    • Datamodel definition with SQLAlchemy (OK - completed)
  • Refactoring of database structure inherited fom GhoSST (OK - completed)
    • Split into multiple schemas (OK - completed)
      • one schema dedicated to all common data (fundamental species, ...)
      • one schema per "database" for all "private" data (experiments, spectra, ...)
    • Implementation of the datamodel upgrades
      • Experimentalist (OK - completed)
      • Instrument (OK - completed)
      • Sample (OK - completed)
      • Mineral species (OK - completed)
      • Matter (OK - completed)
      • Database (OK - completed)

Data ingestion software

  • Import XML files
    • Source
      • Command line (OK - completed)
      • Web interface (OK - completed)
    • Data types
      • Species (OK - completed)
      • Natural objects (OK - completed)
      • Laboratory (OK - completed)
      • Experimentalist (OK - completed)
      • Instrument (OK - completed)
      • Database (OK - completed)
      • Sample (OK - completed)
      • Matter (OK - completed)
      • Experiment & spectrum (OK - completed)
      • Publication (OK - completed)

      • Bandlist/Bands/States (TODO)
    • Features
      • XML validation : OK
      • Import mode: correction, use existing, ... (OK - completed)
      • Optional mandatory (OK - completed)
      • Unit conversion (OK - completed)
      • Resource files : image, PDF,... (OK - completed)
      • Conversion of binary file : Nicolet (OK)
      • History (OK - completed)

SSHADE web interface (search / visualization / export)

      • Google-like Search (OK - completed)
      • Specialized spectrum filters search (OK - completed)
      • Specialized publication filters search (OK - completed)
      • Provider searchs (OK - completed)
      • Spectrum dynamic visu (OK - completed)
      • experiment details visu (OK - completed)
      • spectrum details visu (OK - completed)
      • sample details visu (OK - completed)
      • species details visu (OK - completed)
      • phase details (OK - completed)
      • Publication details (OK - completed)
      • export spectrum / experiment (OK - completed)
      • user dashboard (OK - completed)
      • profiles and settings (OK - completed)

SSHADE web interface (Providers & Managers data management)

      • import (OK - completed)
      • data validation + access (OK - completed)
      • database management (OK - completed)
      • users management (OK - completed)
      • groups management (TODO)
      • backup (OK - completed)

SSHADE wiki (Users and Providers)

      • SSHADE documentation (OK - completed)
      • user help (OK - completed)
      • provider documentation (OK - completed)

Hardware / Software management

  • "Hardware"
    • Deployment of 2 virtual servers (development/production) within the OSUG datacenter infrastructure (OK - completed)
    • Operating system : Debian GNU/Linux 8 (Jessie - Stable)
  • Software
    • Deployment of a forge software: Redmine+Git (OK) with plugins for agile project management (Kanban/SCRUM) and continuous integration (Jenkins)

 

  • No labels
Write a comment…