The zero lecture on my hydrology class. The whole picture of the class is here instead.
My reflections and notes about hydrology and being a hydrologist in academia. The daily evolution of my work. Especially for my students, but also for anyone with the patience to read them.
Tuesday, February 27, 2018
Monday, February 26, 2018
Python general resources (for Hydrologists) to start with
There are a lot of resources to start with python, but for hydrologists, but here I tried, at least at the beginning, a list of readings to be quickly operative.
with a preference for the first one.
- A nice and free general introduction is A Whirlwind Tour of Python either as a book or a collection of Jupyter Notebooks. For further reading and going deeper into some of the main libraries in Python, the same author published Python data science handbook. Unfortunately, this latter book is not for free.
- Jupyter notebooks are a splendid way to organise calculations: you have first to lear how to use them (here a manual: it contains instructions for installation too).
- Lectures on scientific computing with Python by J.R. Johansson cover the main topics very nicely. the first four of more general interest:
- Lecture-0 Scientific Computing with Python (This is a general lecture)
- Lecture-1 Introduction to Python Programming (Just basic notions on programming)
- Lecture-2 Numpy - multidimensional data arrays (Array and vectors)
- Lecture-3 Scipy - Library of scientific algorithms (Doing science with Python)
- Lecture-4 Matplotlib - 2D and 3D plotting (No plots, no science: quite a general introduction)
- For Italians, my own introductory lectures have their place, I believe also because I used Jupyter notebooks (and Python 3) to convey previous work by Joseph Eschgfaeller (translated from Python 2.7).
- Una introduzione gentile al Python scripting (mostly a translation from JE lectures)
- Esperimenti nella lettura di un file
- Leggere un file con PANDAS (e plot dei dati con Matplotlib)
- Scipy Lecture Notes is a good (not necessarily quick) starting. The html version supports hyperlinks that the pdf one does not. You can download the chapters in pdf and at their end, you can download the Jupyter notebooks with the exercises. You can also find part of the exercises here below
- From Wes McKinney (creator of Pandas) Python for data analysis book:
- Chapter 2: Python Language Basics, IPython, and Jupyter Notebooks
- Chapter 3: Built-in Data Structures, Functions, and Files
- Chapter 4: NumPy Basics: Arrays and Vectorized Computation
- Chapter 5: Getting Started with pandas
- Chapter 6: Data Loading, Storage, and File Formats
- Chapter 7: Data Cleaning and Preparation
- Chapter 8: Data Wrangling: Join, Combine, and Reshape
- Chapter 9: Plotting and Visualization
- Chapter 10: Data Aggregation and Group Operations
- Chapter 11: Time Series
- Chapter 12: Advanced pandas
- Chapter 13: Introduction to Modeling Libraries in Python
- Chapter 14: Data Analysis Examples
- Appendix A: Advanced NumPy
- Kevin Sheppard's introduction to statistical analysis with Python also a manuscript to read.
Other resources can be:
- The main NumPy and SciPy documentation.
- Python Scientific Lecture Notes a comprehensive set of tutorials on the scientific Python ecosystem.
- Software Carpentry is an open source course on basic software development skills for people with backgrounds in science, engineering, and medicine.
- Introduction to Statistics an introduction to the basic statistical concepts, combined with a complete set of application examples for the statistical data analysis with Python (by T. Haslwanter).
- They suggests Dive into Python (EN, IT) as a good starting book, and I think it is
- Python Crash course is also a traditional type of book that covers all the traditional element of programming. It is certainly a good book but I would say that its approach does not cope exactly with the modern ‘hip’ approach that a scientist has when using python with more high level infrastructures as Pandas (and partially Numpy and Scipy are) which, for instance often do not require to explicit iterations with “for” loops.
- Think Python (EN, IT) is also an alternative to previous books
- A little different is Thinking in Python, because it is oriented to introduce topics of object oriented (OO) programming which are not usually covered in elementary programming books. Even if OO at its core is to get used to design patterns.
- Python in Hydrology
- Python programming guide for Earth Scientists
- A hands-on introduction to using Python in the Atmospheric and Oceanic sciences
with a preference for the first one.
- Soil Physics with Python: Transport in the Soil-Plant-Atmosphere System, by Bittelli et al, is al, is a book on soil science which is quite appealing (as seen the TOC): the kindle version cost reasonably but it is in Python 2.7. Its Python programs are available here.
Tuesday, February 20, 2018
Costruzioni Idrauliche 2018
This is the material for the 2018 class in Hydraulic constructions at University of Trento. The material, is being revised during the class and is similar to the last year class. A first difference is that slides will be loaded into an Open Science Framework (OSF) repository. More information in the Introductory class below. The name is hydraulic construction. Actually it covers the hydraulic design of a storm water management system and the hydraulic design of an Aqueduct. With hydraulic design, I mean that the class teach how to calculate the hydraulics of infrastructure. It will not teach anything else and neither will cover how to really draw them to produce a final executive project. These knowledges are communicated in the class called "Progetto di Costruzioni Idrauliche".
T - Is a classrom lecture
L - Is a laboratory lecture
Storm water management systems
February
- 2018-02-26
- Introductory Class. (YouTube 2018. Unfortunately non very visible)
- New goals for Urban hydrology. (YouTube 2018. Unfortunately non very visible)
- The sewage systems devices (YouTube 2018. Unfortunately non very visible)
- Local control on the hydrological cycle (YouTube 2018. unfortunately non very visible)
- The law of public works
- The past and the future
- Further readings (optional)
- Using OSF
March
- 2018-03-01 - L - Introduction to Python with Jupyter (We mostly use the three notebook below):
- Una introduzione gentile al Python scripting (mostly a translation from JE lectures
- Leggere file da un file Excel e fare qualche grafico
- Leggere un file con PANDAS (e plot dei dati con Matplotlib)
- Further resources are available in this other post.
- 2018-03-05 - T -
- A little of Statistics and Probability.
- Descriptive Statistics
- Statistics' statistics
- Further readings on Statistics (see also here)
- Probability's Axioms
- Distributions
- Further readings on Probability
- YouTube videos 2018
- 2018-03-08 - L -Explorative data analysis and Simple statistics with Python's Pandas
- Gaussian Distribution
- Central Limit Theorem Illustrated (and some other distributions)
- Gamma Distribution (and some other further Python)
- 2018-03-12 - T - Statistical properties of Extreme precipitations and their interpolation.
- Intensity duration frequency curves
- Gumbel distribution functions
- Moments method
- Maximum likelihood method
- Minimum squares method
- The YouTube video of the class 2018.
- Further readings ( see the Precipitations' post)
- 2018-03-15 - L - Estimation of Extremes with Python
- Exercise: Using the examples of the last Lab, draw a Gumbel distribution.
- Exercise: Select randomly from a Gumbel distribution and empirically shows the effects of the central limit theorem.
- For estimating the Gumbel distribution parameters:
- The YouTube video of the class 2018.
- 2018-03-19 - T - Element for the design of storm water management infrastructures- I.
- The storm water drainage network (SWDN)
- Urban cases
- The estimation of the flood wave (the IUH case) and the Hydraulic design of the SWDN
- YouTube Videos
- 2018-03-22 - L - Estimation of Extremes with Python - II
- 2018-03-26 - T - Elements for the design of storm water infrastructures
April
- 2018-04-5 - L Short introduction to QGIS for representing urban infrastructures.
- Introduction to QGIS by Elisa Stella and Daniele Dalla Torre. For other information about tools installation, see the bottom of the page.
- Using QGIS and GISWater to feed SWMM
- Material/Data of the lab
- Further Video classes on QGIS/GISWATER
- Create subcatchments
- Homogenize the subcatchment layer and insert it in the database
- Geometric information subcatchments
- Average Slope
- Impervious
- Simp, Routeto
- https://www.youtube.com/watch?v=HJIGH-ndcJ4
- 2018-04-09 - T- Pumping stormwaters.
- 2018-04-12 -L Working with SWMM for implementing a storm water management system
- 2018-04-16 - T - Pipes (slides from Roberto Magini) and infrastructures
- 2018-04-19 - L - Simple estimation of the maximum discharge via Python
- Maximum Discharge from a linear reservoir model
- Internal diameter of the pipe
- Summing discharges from pipes (I)
- Summing discharges from pipes (II)
- 2018-04-24 - Midterm written exam
- Question to be answered. Students will be required to answer to two (2) questions randomly chosen and (3) produce e code snippet in Python to perform the task required.
Aqueducts
As a general, simple and descriptive reference, the first six chapters of Maurizio Leopardi's book can be useful :
- Utilizzo Idropotabile
- Il trasporto in pressione
- Dimensionamento idraulico delle condotte
- Acquedotto con sollevamento meccanico
- Serbatoi
- Reti di distribuzione
The state of the water supply in Italy is summarised here (Corriere della Sera, 2018-05-16)
May
- 2018-05-3 L - SWMM and Python problem solving
- 2018-05-7 T - Aqueducts
- Aqueducts in 2020 (YouTube)
- Equations for aqueducts networks (YouTube)
- Mass and energy Conservation (YouTube)
- 2018-05-101 L - Working with SWMM and PYTHON
- 2018-05-14 T - Design of aqueducts networks
- 2018-05-17 L - Introduction to EPANET
- 2018-05-21 T - External aqueducts & Reservoirs
- External aqueducts (YouTube)
- Reservoirs (YouTube)
- Contemporary problems in aqueduct's network management
- 2018-05-24 L - A simple aqueduct configuration with EPANET
- 2018-05-28 - T - Water Sources
- Springs (YouTube)
- Wells (YouTube2018)
- Excavations (optional)
- Surface Waters
- Generalities
- Small Intake (YouTube2018), Grid (Optional)
- Channel (Optional)
- Sand Remover (Optional)
- 2018-05-31 - L - Working with EPANET to design an aqueduct
June
- 2018-06-04 T -
- 2018-06- 11 L - Problem solving with EPANET
During the class I will introduce sever tools for calculations.
- Open Science Framework (OSF): It is a tool for sharing a workflow, especially design for scientific purposes. It allows storage of files and documents and their selective publication on the web.
- Python - Python is a modern programming languages. It will be used for data treatment, estimation of the idf curves of precipitation, some hydraulic calculation and data visualisation. I will use Python mostly as a scripting language to bind and using existing tools.
- SWMM - Is an acronym for Storm Water Management System. Essentially it is a model for the estimation of runoff adjusted to Urban environment. I do not endorse very much its hydrology. However, it is the most used tools by colleagues who cares about storm water management, and I adopt it. It is not a tool for designing storm water networks, and therefore, some more work should be done with Python to fill the gaps.
- EPANET Is the tool developed by EPA to estimate water distribution networks.
- GISWATER: http://growworkinghard.altervista.org/giswater-11-install-windows/
- QGIS: http://growworkinghard.altervista.org/qgis-2-18-how-to-install-step-by-step-on-windows/
Some Examples of presentations on the projects of this class:
Questions for the midterm exam
Domande della prova intermedia 2017.
Grades (voti) of the intermediate exam.
Sunday, February 18, 2018
Conoscere, comunicare, gestire il rischio idrogeologico in ambiente montano: 3/3
On February 15, 2018, we had the second day of the workshop: "Know, communicate and manage the hydrological and geological risk in mountain environment", originally intended for journalists, technicians, as politicians. It was held at the Department of Civil, Environmental and Mechanical Engineering Department of the University of Trento. This page reports the second day.
The first part of the workshop can be found in two previous post:
The first part of the workshop can be found in two previous post:
- Introduction
- About Italian legislation on hazards by Eugenio Caliceti
- Planning Emergencies after natural hazards by Marta Martinengo
- The hazard map of Trentino Province by Mauro Zambotto
- Discussion after dott. Zambotto presentation
- Comments on work groups simulations by Rocco Scolozzi
Conoscere, comunicare, gestire il rischio idrogeologico in Ambiente montano: 2/3
On February 7 and 15, 2018, it was organised a workshop entitled "Know, communicate and manage the hydrological and geological risk in mountain environment", originally intended for journalists, technicians, as politicians. It was held at the Department of Civil, Environmental and Mechanical Engineering Department of the University of Trento. The morning talks are in another post.
The Afternoon was dedicated to a Conference open to the wide public. It covered the topic of which you see the YouTube videos below.
Other two pages refer of the conference:
The Afternoon was dedicated to a Conference open to the wide public. It covered the topic of which you see the YouTube videos below.
Other two pages refer of the conference:
- The Experience of major Ugo Grisenti after the Campolongo event (August 15, 2010)
- Some images from Campolongo
- Information (about hazards) from the institutional channel by Giampaolo Pedrotti
- Andrea Selva on the information on natural hazards (from the point of view of a local newspaper)
- The judge and hazards: the experience of Carlo Ancona
Friday, February 16, 2018
Conoscere, comunicare, gestire il rischio idrogeologico in Ambiente montano 1/3
On Wednesday 7 and Thursday 15 February 2018 we held at our Department (DICAM) a workshop entitled: Know, communicate and manage hydro-geological risks in mountain environments. This workshop was one of the events of the Life FRANCA project. Please find below, in Italian, the YouTube of the talks.
The days were split into other two pages other than this one related to the first morning:
The days were split into other two pages other than this one related to the first morning:
First day (February 7, 2018)
- Introduction to the workshop by Luigi Fraccarollo
- Introduction to Life FRANCA by Rocco Scolozzi
- A review on hydrological hazards for non specialists by Riccardo Rigon
- A little of discussion
- What is "hazard" by Giorgio Rosatti
Subscribe to:
Posts (Atom)