Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in / Register
  • I IRMaRA
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 5
    • Issues 5
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • IN-WOP
  • IRMaRA
  • Issues
  • #1

Closed
Open
Created Jun 17, 2020 by Dorchies David@david.dorchiesOwner

Scrapping of real-time data on SGL website

Lot of data are available with 30 days of history.

Data are stored in json files at this kind of url: https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Aube9

It seems that the end of the URL is composed with the name of the lake and a number.

Each time series is described in the source code "lake" page such as: https://seinegrandslacs.fr/fr/quatre-lacs-reservoirs/lac-reservoir-marne behind a tag property data-locations

[
  {
    "id": "Pann1",
    "label": "Rigole Yonne (canal du Nivernais) (m3/s)",
    "mnemonic": "SITE_PANNECIERE_RIGOLE DU NIVERNAIS_TOTAL",
    "title": "Rigole Yonne (canal du Nivernais) - Débit en m3/s",
    "longitude": "3.844577",
    "latitude": "47.165558",
    "label_position": "Non",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann1",
    "average": "1.8"
  },
  {
    "id": "Pann3",
    "label": "Montigny-en-Morvan (Chassy) (m3/s)",
    "mnemonic": "SITE_PANNECIERE_RIVIERE_YONNE AVAL LAC",
    "title": "Montigny-en-Morvan (Chassy) - Débit en m3/s",
    "longitude": "3.836335487",
    "latitude": "47.1713948",
    "label_position": "Non",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann3",
    "average": "1.9"
  },
  {
    "id": "Pann4",
    "label": "Lac - Niveau (mNGF)",
    "mnemonic": "SITE_PANNECIERE_STOCKAGE_ALTITUDE",
    "title": "Lac de Pannecière - Niveau en mNGF ortho",
    "longitude": "3.893144",
    "latitude": "47.153964",
    "label_position": "Oui",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann4",
    "average": "322.03"
  },
  {
    "id": "Pann5",
    "label": "Lac - Volume (M. de m3)",
    "mnemonic": "SITE_PANNECIERE_STOCKAGE_VOLUME",
    "title": "Lac de Pannecière - Volume en M. de m3",
    "longitude": "3.893144",
    "latitude": "47.153964",
    "label_position": "Oui",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann5",
    "average": "73.0"
  },
  {
    "id": "Pann7",
    "label": "Houssière, amont lac (Ardoux) (m3/s)",
    "mnemonic": "SITE_PANNECIERE_RIVIERE_HOUSSIERE AMONT LAC",
    "title": "Houssière, amont lac (Ardoux) - Débit en m3/s",
    "longitude": "3.940267",
    "latitude": "47.144498",
    "label_position": "Non",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann7",
    "average": "0.3"
  },
  {
    "id": "Pann8",
    "label": "Yonne, amont lac (Corancy) (m3/s)",
    "mnemonic": "SITE_PANNECIERE_RIVIERE_YONNE AMONT LAC",
    "title": "Yonne, amont lac (Corancy) - Débit en m3/s",
    "longitude": "3.941558",
    "latitude": "47.103219",
    "label_position": "Non",
    "link": "https://seinegrandslacs.fr/fr/stratis-lakes/get-popup/Pann8",
    "average": "0.6"
  }
]
Assignee
Assign to
Time tracking