|Observatories and Research Facilities for EUropean Seismology|
|Volume 5, no 1||March 2003||Orfeus Newsletter|
Linux based LISS systems. The ISEV and SISLook examplesA. Llobet1,2, J. Vila1,2, O.Fors1,4 and R.Macià2,3
1Departament d'Astronomia i Meteorologia, Universitat de Barcelona
In this contribution we present a general scheme for the development of Live Internet Seismic Server (LISS) class servers based on Linux and TCP/IP connections using Secure File Transfer Protocol (SFTP). The objective is to develop a cheap and easy way to implement a very stable system with minimum hardware requirements. At the same time we require good performance and robust data loss prevention. Moreover, we will show how real-time analysis of the recorded data can be easily implemented in this system. Real-time analysis is a good tool for data quality control, for quick detection of station malfunctioning or for specific experimental needs.
A system of this kind has been implemented as a Live Internet Seismic Server (LISS) at the Observatori Fabra of the Reial Acadèmia de Ciènces i Arts de Barcelona in collaboration with the Departament d'Astronomia i Meteorologia of the Universitat de Barcelona. It can be accessed at the d'Iinformació Sísmica En Viu (ISEV) website.
In the first section we will explain how the system works and the choice of the software. After that we will explain the actual implementation of the ISEV system. In the third section the real-time capabilities of the system are explained and its use in the ISEV system is presented. To finish we present further developments and a complementary service SISLook (Seismogram Information Server) that provides an easy way to do a preliminary visual inspection of the seismograms in the datafarm. This service allows you to view selected segments or full days.
Figure 1. Data flux diagram of the Station subsystem.
In the STATION we have a PC-based system that periodically extracts the data from the ring buffer and converts it to fully compatible SEED-volumes. In this process the headers are edited, checked and changed when necessary. After the volumes have been generated they are stored into a machine running under Linux and configured as SFTP server. Two copies of each volume are made, one in the local directory where all the data is stored for backup, the second in a temporary directory used for data transmission via SFTP. The temporary directory contains all the data that has not been yet successfully requested by the DATA CENTER.
The DATA CENTER, acting as client, requests periodically all the data currently stored in the temporary directory of the STATION, the server. Once a SEED-volume is successfully received and stored in the DATA CENTER its temporary copy is deleted. If a connection fails the data remain in the temporary directory and will be requested in the following connection. This is a very simple way that prevents any loss of data during the transmission.
Figure 2. Data flux diagram of the DATA CENTER and services offered to the public.
When new data is received the DATA CENTER organizes it into de datafarm, updates the 24h plots and does the RT analysis. The data stored in the datafarm, the 24h plots and the results of the RT analysis are made visible to the public by means of a web page with script executing capabilities. Moreover, an AutoDRM system makes the datafarm accessible. Both the processing and serving tasks can be done using computers running Linux.
Up to now we have explained the general working scheme of
the system. Now we want to underline the reasons to choose Linux as the base
system and SFTP as transmission protocol.
Figure 3. ISEV system scheme.
The STATION subsystem is located in the Observatori Fabra.
The data in the Ring Buffer is extracted periodically (every 30 min) by the
Nanometrics' program "Archiver". It runs under OS/2 warp 4 in a PI 133MHz
machine. The "Archiver" has been modified so it now generates full SEED-volumes:
they include the response information. After its creation each volume is
sent via FTP to the linux SFTP server; this FTP transmission is done in a
private network. Two copies of each are made, one into the backup directory
and the other into the temporary directory. The linux server runs on a PI
Figure 4. ISEV website snapshots.
a)Daily 24h waveform plot. Corresponding to Fabra Station (FBR) on the current day (15 October 2002). b)Zoomed view of the previous 24h waveform plot. c)24h Waveform plot of a selected day from the datafarm. In this case the day when the Sicila earthquake occurred (6 August 2002). d)Temporal segment from the datafarm corresponding to a local event occurred the 5th October 2002. It shows the SHZ channel from FBR and FONT stations. Click figures to see larger images.
Both the web server and the AutoDRM run on a Sun Server
under SunOS 5.6. This machine only administers the requests for the ISEV
and runs the cgi-Perl scripts. All the pages, plots and data shown in the
webpage or accessible via AutoDRM are stored in the Linux machine. This data
is mounted in the Sun Server using NFS.
The implementation of new tasks to be applied to incoming data after each request is only limited by the CPU capabilities of the receiving system. These tasks are executed sequentially before the incoming data are removed from the temporary incoming directories at the end of the process.
Figure 5. Snapshots of the RT analysis results.
a) Minimum spectra for FONT station. b) Time series for the frequency of the maximum, FBR station. Sudden changes of this value not related with earthquakes can show changes in the station behavior. Click figures to see larger images.
In the ISEV website the minimum spectra, and the time series corresponding to the amplitude of the maximum and its frequency are shown (Figure 5). These plots, mainly the one showing the evolution of the frequency of the maximum, allow the distant monitoring of the behavior of the sensors and recording system.SISLook website. At this moment this data is not transfered in real-time to the Data Center. However, a system like the one presented here would be easily implemented when these stations get access to the Internet and this is our next main goal. The SISLook provides the users the possibility to do a preliminary visual inspection of the data before doing any request. This service has been proved to be very useful when waveform data with certain characteristics is required. In particular, for those analysis that are very sensitive to S/N ratio. This preliminary work may reduce waste of time in useless requests and analysis.
The SISLook web page also links to corresponding stationbooks where full information of the operation of each station can be found. Included history, response files, noise studies, log books and any other incidences that may have affected the normal operation of each station.