Abstract:Flat-fielding spectro-polarimetric data with one spatial and one spectral dimension is inherently difficult as the imprint of the spectral lines needs to be separated from other wavelength-dependent instrumental effect (e.g., fringes or prefilter profiles) and wavelength-independent effects (e.g., dust and sensor response). Current approaches for spectrometers are often based on moving the grating or they depend on optical models and/or on lab calibration data. They are also limited to small spectral regions and are instrument-specific. Approaches that would be suitable for polarimeters have not been reported yet. We present an approach that allows for flat-field calibration data to be to obtained for diffraction-grating-based, long-slit spectrographs combined with temporally modulated polarimetry from high-resolution solar telescopes. This approach is based on nominal flat-fielding procedures performed during the instrument's science operations. We performed a precise and field-dependent correction of the spectrographic distortion effect (resulting in curved spectral lines, typically denoted as a "smile" effect) to ensure the orthogonality of the spectral and spatial dimensions. We identified distortions by tracking the position of multiple spectral lines within the full spectral field of view. From the raw modulated flats, we then removed the solar line imprints and derived separate flat-fields for sensor and slit dust features. Optionally, wavelength calibration and continuum correction can be included in this process. We have created generic Python libraries that can be plugged into existing Python-based data reduction pipelines or used as a standalone calibration tool. We show that for spectrographs covering many spectral lines, a correction of the smile distortion based on optical models alone is not sufficient. Our results demonstrate a suppression of fringes, sensor artifacts, and fixed-pattern imprints in demodulated data by one order of magnitude. For intensity images, the photon noise level can be closely attained after calibration. Our correction works across the full spectral range. The algorithm was tested for different wavelength regimes with emission (EUV range) or absorption (near-UV, VIS, IR range) spectra, on data acquired with ground-based (SST/TRIPPLE-SP, GREGOR/GRIS), balloon-borne (SUNRISE-III/SUSI), and space-based (SolO/SPICE) instruments. The data calibrated with our method offer robust and precise inversion results. We have extended existing spectroscopic flat-field techniques to modern instruments with large imaging sensors covering many spectral lines simultaneously, and with polarimetric capabilities, where methods described so far are not adequate. We believe that our method is applicable as a standard calibration approach for most modern high resolution large-FOV, long-slit spectrographs -- both with and without polarimetric capabilities.

RASCAL: Towards automated spectral wavelength calibration

Research on Automatic Spectral Calibration Algorithm for Echelle spectrometer

CARRSSPipeline: Flux Calibration and Non-linear Reprojection for SALT-RSS Multi-Object Spectroscopy over 3500-9500 Å

Adaptive wavelength calibration algorithm for LAMOST

Robust Full-Screen Wavelength Calibration Algorithm

Spectroflat: A generic spectrum and flat-field calibration library for spectro-polarimetric data

Subspace Partial Least Squares Model for Multivariate Spectroscopic Calibration

Random Noise Reduction with More Accurate Calibration for a Spectrometer Using a Two-Dimensional Array Detector

Improved Wavelength Calibration by Modeling the Spectrometer

Concept of a Satellite Cross-Calibration Radiometer for In-Orbit Calibration of Commercial Optical Satellites

Calibration transfer between different spectrometers by wavelength correspondence

Wavenumber Calibration Protocol for Raman Spectrometers Using Physical Modelling and a Fast Search Algorithm

Wavelength calibration by combining arc and night sky lines for LAMOST

Working Principle of the Calibration Algorithm for High Dynamic Range Solar Imaging with the Square Kilometre Array Precursor

Optimising the selection of samples for robust lidar camera calibration

Calibration of Dual-Channel Raman Spectrometer via Optical Frequency Comb

Comparison of On-Sky Wavelength Calibration Methods for Integral Field Spectrograph

An Efficient Feedback Calibration Algorithm for Direct Imaging Radio Telescopes

Working Principle of the Calibration Algorithm for High Dynamic Range Solar Imaging with Square Kilometre Array Precursor

Spectral Redundancy for Calibrating Interferometers and Suppressing the Foreground Wedge in 21cm Cosmology

The Relative Calibration of Radial Velocity for LAMOST Medium Resolution Stellar Spectra