[NeXus-committee] DECTRIS example summary

[Pete Jemian]

Wow!  That is a new view and it confuses me incredibly.  There is no 
metadata or other indication that one should recombine the data 
presented this way.

Is there any NeXus mechanism to join together into one dataset the 
content of several linked arrays?  Can someone sketch up an example? 
Who is prepared to receive such a dataset and reassemble it?

Your option 1 is the only way I can see now, yet I do not understand how 
to concatenate the arrays.

Perhaps, could this be written as a multi-file chunked dataset?

Pete

On 1/14/2013 8:51 AM, Watts Benjamin wrote:
> I think that everyone is looking at the Dectris data the wrong way. It
> is a single data array and is only broken up into separate files because
> of performance issues. Therefore, ideally, all the data shoud be written
> into a single NXdata group. Since we are forced to receive it in
> separate files, linking is an obvious solution. However, links in NeXus
> have always been discrete - mapping one location to one array in another
> location. Our situation here is different, with the one array being
> separated into a number of pieces in different locations. The master
> file needs some way of saying "my data is there, and then continues
> there, and there and there...", which does not yet exist (to the best of
> my knowledge). Options for doing this include:
>
> 1. The NXdata group of the master file contains a list of external
> links, with the order of the list describing the order in which the
> linked arrays should be concatenated.
> 2. The master NXdata group links to the first part of the array and then
> the file containing that first part has some record pointing to where
> the data is continued.
> 3. Both could be done together.
>
> Option #1 seems best to me.
>
> Cheers,
> Ben

-- 
----------------------------------------------------------
Pete R. Jemian, Ph.D.                <jemian at anl.gov>
Beam line Controls and Data Acquisition, Group Leader
Advanced Photon Source,   Argonne National Laboratory
Argonne, IL  60439                   630 - 252 - 3189
-----------------------------------------------------------
    Education is the one thing for which people
       are willing to pay yet not receive.
-----------------------------------------------------------