Help page to the FUSE database at IAP


http://fuse.iap.fr/interface.php




Which data are accessible?

What's inside the database?

What is the diference with the MAST archive?

How to access the spectrum?

What is the definition of the FUSE data filename?

How many interfaces to this database?

How to use the Quick Interface?

How to use the Research Interface?

Example of SQL requests

How to submit a list of dataset?

How to get a list of dataset?

How to change the wavelength scale of a displayed spectrum?

What are the downloadable data?

How to display my local FUSE data?

How does this database work?

Who developed this database, contact, requests and acknowledgement?








Which data are accessible?

The FUSE database at IAP contain the spectrum of all the current public observations (raw and calibrated).
This database contain also the reference of all the observation (public or not) but doesn't contain the non public spectrum (weekly updated).

If you need to know more about those data, read "The FUSE Instrument and Data Handbook". Need to know more about FUSE, read "The observer Guide".
FUSE homepage, and the French website.



What's inside the database?

The database does not contain data but metadata. The public data (spectrum) are stored in a disk cluster and are accessible by the user at anytime.
This part describe the tables and fields accessible on fusebd.
The database contains 4 tables:

 Table  Records Size
 FUSE_PRG_ID   546  599.8 KB
 HEADERS   3,924  611.4 KB
 IAPDATASETS   3,560  235.7 KB
 OBJECT_CLASS   100  3.4 KB
 4 table(s)  8,130 1.4 MB

            Structure of the Database

FUSE_PRG_ID  : contains information related to the different programs
HEADERS  : contains main informations of all observation headers (public and private)
OBJECT_CLASS  : contain the IUE object class used by the FUSE mission. Check the OBJECT_CLASS result table based on IUE catalogue (100 object referenced).
IAPDATASETS 
: contains informations of all public observations loaded at IAP.

Here is the field description of each table.

Notes: The user can easely access those 4 tables through " Research from all kind of request" from the main interface.




What is the diference with the MAST archive?

The STScI FUSE archive at MAST is an archive and doesn't allow to make research on any kind of data, you have to know the object name or the references of the observation to access the data.
The FUSE database at IAP allow you to access the spectrum from any kind of research, and compare different spectrum from different observations (i.e. objects).
This specificity is interresting to get familly object from multiple search cross correlation, to make surveys, to download simultaneous observations, etc...
An other difference is also that this database is connected to the Vizier project at CDS and the virtual observatory through SSAP access.
Finally, you get instantaneously the spectrum you have required without waiting few hours like for the MAST.
MAST archive allow you to get not only the calibrated files like the FUSE database at IAP, but the raw and engeneering files necessary for a new calibration.



How to access the spectrum?

2 interfaces have been designed to access the information you want to get:
From your selection, you can get any spectrum you have choosen.



What is the definition of the FUSE data filename?

Example : P11001010122bsic4ttagfcal.fit

P110 : Program ID reference.
01     : Number of the target HS1103+6416 in program P110.
01     : Number of the observation of the target 01.
012   : Exposure number.
2b     : Channel (1a, 1b, 2a, 2b)
sic     : Mirror (sic, lif)
4       : Slit number  (1:PINH, 2:MDRS, 3:HIRS, 4:LWRS)
ttag   : Acquisition mode TTAG (Photon adress mode) or HIST (Spectral image mode)
fcal   : Related to calibrated pectrum.
.fit    : FITS format .

If you want to know more, please read "The FUSE Instrument and Data Handbook".




How many interfaces can access  this database?

Like previously described in  How to access the spectrum? 2 interfaces have been developed The Quick interface and the Research interface.



How to use the Quick Interface?

 The Quick interface:

Name of the object:

The name, or part of the name is admitted:

ex: WD2211-495 ->
      wd, wd%, WD, Wd, WD2211, wd2211%, WD2211-,WD2211-495, etc... are accepted
Not case sensitive, but space sensitive.

You can resolve the name of the target with Simbad or NED resolver.

Name of the program :

The program name, or part of the name is admitted:
ex: M1030101  ->
      M,m,m10, m103,M103, m1032%, etc... are accepted

All files produced and used by the Calibration Pipeline have a unique root name based on the naming convention used in the Mission Planning system for managing program IDs, targets and exposure numbers. The first eleven characters of all file names are the same format, which we call the root name: ppppttooeee, where pppp is the proposal ID (also called the program ID), tt is the target ID, oo is the observation ID, and eee is the exposure ID (all assigned by Mission Planning). Imagine that proposal A102 has three targets which are to be visited four times each with five exposures per visit. The root name of the fifth exposure (eee=005) of the fourth observation (oo=04) of the third target (tt= 03) in proposal A102 (pppp=A102) would be A1020304005.

Ra and Dec accepted in various format:

Ra : Dec:
12 22 31
12       22        31
12 22 31.98 12h22m31.98s
12 h 22 m 31.98 s
12:22:31.98
29 53 45
29    53     45.55
29 53 45.55    29d53m45.55s
29 d 53 m 45.55 s
+29:53:45.55
Radius : Cone search


Show all the parameters:

Select this if you want to display all the field of the HEADERS table in the new_interface_reponse.php script, otherwise, the main important field are displayed such as :

Dataset
(See spectrum)
Target
(Link Simbad)
RA (J2000)
DEC (J2000)
Date obs (Y-M-D)
Total Time obs (Ksec)
Download spectrum
A0340601
WD2218+706
22 h 18 m 22.08 s
70 d 40 m 54.12 s
2000-01-17 17:34:25
11.61
A0340601.tar.gz
(7 Mo) MAST




How to use the Research Interface?

As soon as you access the
"Research from all kind of request" main interface, a SQL prompt will allow you to send your personal SQL requests and this main frame navigation menu is displayed:

  Structure   SQL   Export   Search   Query  



The "Structure"
atthe top frame menu is helpfull if you need to know more about the tables and fields, this will give you access to all the databse definition (tables, fields, key, etc...). You can see here for a complete view of the field description of each table.

The "Browse" menu allow to see all the line currently present in the database (select firts a table in the "structure" menu).

The "SQL" menu allow you to send to send your personal SQL requests or to dowload a text file which contain your list of requests. A documentation link for MySQL is also available from this page. See the Examples to simply use this interface.

The "Export" is a solution to export or save the tables (or part of) in an ASCII file in the format desired  (
see: Examples of SQL requests "Example 4").

The "Search" is a very efficient and simple interface to select one or many fields with and/or operators (don't forget to select firts a table in the "structure" menu)

Field Type Function Value
DATASET varchar(8) a100% 
TARGNAME varchar(30)
RA_TARG float
.
..
...
          Note that it is not case sensitive and that you add a % as a wildcard.




Example of SQL requests

Particularly interesting to send request to the SQL request sender in  "Research from all kind of request" ...

...or  if you just want to send a request loaded an ascii file from the Quick interface (See How to submit a list of dataset?)


Example 1) (Fields constrains and operators)

Suposed you want to sort out all the O B stars, SD O and SB D from the GI observation (dataset begining by A,Bor C)

Here is the SQL request you will send:
select * from HEADERS where (DATASET like 'A%' or DATASET like 'B%' or DATASET like 'C%') and (OBJCLASS='12' or OBJCLASS='13' or OBJCLASS='14' or OBJCLASS='15' or OBJCLASS='16' or OBJCLASS='20' or OBJCLASS='28') group by DATASET LIMIT 0 , 30

Try it in the the main SQL request window  here.

Let's describe each part of this request:
SELECT *       ; * means you select all the fields...
FROM HEADERS  ; ...of the table HEADER
WHERE (
DATASET   ;you constrain the DATASET fileds...
LIKE 'A%' OR DATASET  ;...staring by A, the % means whatever after A...LIKE 'B%' OR DATASET  ;...or staring by BLIKE 'C%' ;...or staring by C) AND (      ; you will display the firts ; An other constranint, with the restrictive operator "AND"
OBJCLASS = '12' OR OBJCLASS = '13' OR OBJCLASS = '14' OR OBJCLASS = '15' OR OBJCLASS = '16' OR OBJCLASS = '20' OR OBJCLASS = '28'
; The other constrain is related to the type of object 
checked previously on the OBJECT_CLASS table.
GROUP BY DATASET ; You avoid all the double (same DATASET, but different calibration)
LIMIT 0 , 30 ; Means that you display the first 30 result on the screen


Example 2) (Fields comparison and sort)

Suposed you want all the stars which are not WDA with an extinction higher than 0.1, and sort them by increasing order of Eb-v
Here is the SQL request you will send in the the main SQL request window  here:
select DATASET,TARGNAME,EBV,VMAG,SRC_TYPE,OBJCLASS from HEADERS where EBV > 0.1 and SRC_TYPE ='PC' and OBJCLASS  BETWEEN 10 AND 79 and OBJCLASS  NOT LIKE 37 order by EBV ;

NOTES:
You select the field that you want to extract after the "SELECT" parameter.
Use "BETWEEN"  keywords for intervals
Use
"ORDER BY"  to sort by a specific field
Use "NOT LIKE "  to eliminate the WDA (objectclass 37)
          Point continum (PC) is used for point source object
      

Example 3) (Join tables)

You want all the date (and time) of the observation, and the exposure time of all the MDRS exposure that have recorded more than 50000 events.
You need to access the DATASET,EXPTIME,DATEOBS and APERTURE than are in the HEADERS table and you need also to access the NEVENTS and TIMEOBS which are in the other table IAPDATASETS: you need to join tables.

Here is the SQL request you will send in the the main SQL request window  here:
SELECT HEADERS.DATASET,EXPTIME,DATEOBS, TIMEOBS FROM HEADERS, IAPDATASETS WHERE HEADERS.DATASET=IAPDATASETS.DATASET AND NEVENTS>50000 AND APERTURE ='MDRS' GROUP BY DATASET ORDER BY TIMEOBS

Let's describe each part of this request:
SELECT HEADERS.DATASET, EXPTIME, DATEOBS, TIMEOBS  ;Display DATASET, APERTURE, EXPTIME, DATEOBS from the table HEADERS and TIMEOBS from IAPDATASETS.
FROM HEADERS, IAPDATASETS       ;Selected tables in wich you will make the research
WHERE HEADERS.DATASET = IAPDATASETS.DATASET   ;Precise that you use the previously selected HEADERS.DATASET to constrain the dataset in IAPDATASETS  table
AND  NEVENTS >50000 AND APERTURE = 'MDRS' GROUP BY DATASET ORDER BY TIMEOBS  ;constrain on both unambiguous fields

Example 4) (Export your selection)

If you want to save the result of your request in a file read this part.

You want to get the DATASET,TARGNAME,GLAT,GLONG,VMAG,EBV,SP_TYPE, from 4 specific datasets in an ASCII file.
Here is the SQL request you will send:
SELECT DATASET,TARGNAME,GLAT,GLONG,VMAG,EBV,SP_TYPE FROM HEADERS where DATASET='A1110101' or DATASET='A1180404' or DATASET='A1180802' or DATASET='A1200501'or DATASET='A1201301'

                At this step you can either send the selection to the display interface by selecting "Send this selection to the display previewer interface" or save your selction in an ascii file following those requirements:

Example 5) (Submit your dataset selection)

See How to submit a list of dataset?

 


How to submit a list of dataset?

File to upload:
 

If you have a list of a dataset to require (obtain from a previous request for example, or a list that you buid yourself) just  select "Load list or request" frm the main Quick interface footpage menu:

Load list or request
|
Research from all kind of request. >>

 

This page will ask you a properly formated ascii file containing a list of dataset or filename (that exist or not) or blank. For example:

A0340601
A0341602
A0341603
M1030101

A120130100000all4histfcal.fit
M1030102
M1030103

 

Or directly a file containing the request like:

SELECT DATASET,TARGNAME,GLAT,GLONG,VMAG,EBV,SP_TYPE FROM HEADERS where DATASET='A1110101'or DATASET='A1201301'

 


How to get a list of dataset?

Now that you have send your request you will get the result in the "new_interface_reponse.php" script:


<< Back to the interface | Plot lines | Download this ASCII table

Dataset
(See spectrum)
Target
(Link Simbad)
RA (J2000)
DEC (J2000)
Date obs (Y-M-D)
Total Time obs (Ksec)
Download spectrum
A0340601
WD2218+706
22 h 18 m 22.08 s
70 d 40 m 54.12 s
2000-01-17 17:34:25
11.61
A0340601.tar.gz
(7 Mo) MAST
A0341601
WD2218+706
22 h 19 m 33.84 s
70 d 56 m 3.84 s
2000-08-15 18:37:39
6.054
A0341601.tar.gz
(4 Mo) MAST


From this script, you can display the spectrum of each independant dataset (first column see spectrum) or use the "plot lines" tool that display a specific line of all the dataset that you have required. You can also save the result of the request in an ASCII file.


Important note:   if you use the "plot lines" tool, the time and the memory required to display the selected lines increase of course with the number of spectrum.

You can also obtain a list of dataset also from the  "Research from all kind of request" interface. (see the "Export" solution Examples of SQL requests "Example 4"). As soon as you have send your request and export it, you can save it in an ascii file or "Send this selection to the display previewer interface". For this last one, you need at list to have required a column of DATASET (select DATASET, what you want....from what you want...)


How to change the wavelength scale of a displayed spectrum?

This can be particularly efficient if you are searching for a specific line.
You can always choose the wavelength range in Angstroms under the spectral window, then the next spectrum will be displayed with this new setting. Just "Unzoom" to go back to the full scale spectrum.






Wavelength range : - Angstroms | Unzoom
M103010100000all3histfcal.fit: Sum of all the detectors and exposures for the observation M1030101 with the HIRS aperture
/9
Plot lines tools
(For ALL spectrum)
|
Get this FITS file
(Do not use for science!)
|
Download all this observation
(23 Mo)



Note that  if you want to display a specific set of lines you have access to the "Plot lines " tool for all the spectrum of this observation from this menu. If you want to compare a line in between different observation, then report to the answer of How to handle a list of dataset?

If you get the displayed spectrum, don't forget that it is a sum of differents channels (i.e telescope) and exposure, so it is not recommanded to use them for science. We strogly advice you to Download all this observation  and to coadd each independant channel. This can be done for example very easely by using the xiplot tool.


What are the downloadable data ?

This database give access to the scientific data of any observation, you can so download all the spectrum taken for any observation.

In the figure above, you can get the archive of the calibrated spectrum by selecting "Download all this observation".

For example, in the case of the P1100101 program, you will be able to get the compressed file : P1100101.tar.gz
The file P1100101.tar.gz contains all the scientific calibrated files:

   -P1100101.tar.gz
       |--- README                  :
       |
       |--- P110010100000all4ttagfcal.head : the general header in an ASCII file, the 4 means the LWRS slit and TTAG, the mode of observation
       |--- P110010100000all4ttagfcal.fit : the sum of all the channels (1alif, 2bsic...) and all the exposure
       |--- P110010100100all4ttagfcal.fit : the sum of all the channels for the exopsure 1
       |--- P11001010011alif4ttagfcal.fit  : exposure 1, channel 1 alif
       |--- ...




How to display my local FUSE data?

Now that you have downloaded the archive of one observation and got the spectrum on your personal directory, you need a tool to display them.
The best tool to do that is an idl tool call "xiplot", you can download it here.



How does this database work?

The Database FUSE is running on fusebd Redhat serveur at IAP. The Apache http serveur display the PHP interfaces on the internet network and the database system is powered by MySQL. A 1.2 To RAID5 linux filesystem supported



Who developed this database, contact and acknowledgement?

The French FUSE team at IAP has develop this tool supported by the CNES.
Contact and requests should be sent at: bdfuse@iap.fr
Acknowledgement: If the IAP FUSE database was helpful for your research work, the following acknowledgment would be appreciated:
This research has made use of the FUSE database, operated at IAP, Paris, France.













Contacts: bdfuse@iap.fr        FUSE home page        Go to the Quick interface

Last update: Thu Apr 28 2005