Issue 
Mechanics & Industry
Volume 21, Number 4, 2020



Article Number  413  
Number of page(s)  12  
DOI  https://doi.org/10.1051/meca/2020035  
Published online  25 June 2020 
Regular Article
Kinematic SAMI : a new realtime multisensor data assimilation strategy for nonlinear modal identification
^{1}
QUARTZSUPMECA – Institut Supérieur de Mécanique de Paris,
3 rue Fernand Hainaut,
93400
SaintOuen, France
^{2}
Univ Rennes, INSA Rennes, LGCGM  EA 3913,
F35000
Rennes,
France
^{3}
Université de Toulon, Bâtiment M,
CS 60584,
83041
Toulon CEDEX 9,
France
^{*} email: adrien.goeller@supmeca.fr
Received:
22
February
2019
Accepted:
5
April
2020
In many engineering applications, the vibration analysis of a structure requires the set up of a large number of sensors. These studies are mostly performed in post processing and based on linear modal analysis. However, many studied devices highlight that modal parameters depend on the vibration level non linearities and are performed with sensors as accelerometers that modify the dynamics of the device. This work proposes a significant evolution of modal testing based on the real time identification of non linear parameters (natural frequencies and damping) tracked with a linear modal basis. This method, called KinematicSAMI (for multiSensors Assimilation Modal Identification) is assessed firstly on a numerical case with known non linearities and secondly in the framework of a classical cantilever beam with contactless measurement technique (high speed and high resolution cameras). Finally, the efficiency and the limits of the method are discussed.
Key words: Experimental modal analysis / Extended Kalman Filter / Data Assimilation / Nonlinear identification / Realtime
© AFM, EDP Sciences 2020
1 Introduction
Measurements in structural dynamics are used to identify and update models in order to determine the stability, safety and lifetime of mechanisms under operational or exceptional conditions. In many cases, this experimental process is developed in the scope of modal analysis. Modal analysis is a very wellknown tool which consists in measuring input and output signals in order to define the studied system in terms of modal parameters (natural frequencies, damping ratio and mode shapes) [1]. Modal parameters are often identified in the frequency domain from Experimental Modal Analysis (EMA) techniques by using the Frequency Response Functions (FRF) and this method solves efficiently many problems [2].
In experimental modal analysis, experiments are often performed using a limited number of measurement points. These measurement points are mostly acquired using accelerometers. The presence of these sensors on the studied structure induced some drawbacks. First, the added mass effect induced by the sensors located on the structure can affect its natural frequencies and mode shapes. Moreover, wires used to connect sensors to the acquisition systems modify the measured modal damping. These drawbacks and the limited number of measurement points are successfully avoided in many studies with laser measurements [3,4]. However, this technique is based on sequential scanning method and need to study the dynamics of structures with periodic or repeated deterministic responses. Transient and random excitation cannot be studied with this technique by measuring all points in the same time. The commonly used solution consists in reproducing the same excitation (transient or pseudo random) for each measured point. However, the experimental process is yet much longer and numerous assumptions are required: the system is assumed to be deterministic and stationary and measurements have to be synchronized.
The motivation of this work is to tackle these drawback. Part of the solution consists in using contactless devices such as laser, micro wave, or high speed vision. The purpose of this article is to introduce a new realtime method which is able to identify nonlinear modal parameters using a large number of observation points from different contactless sensors input.
In most of the recent methods modal parameters are assumed to be obtained from a linear structure. However, for industrial structures such as aircraft, space launchers, bridges, but also for smaller structures like brakes or ski, weak non linearities can be observed even for small vibration levels. These weak non linearities modify natural frequencies and modal damping which depend on the vibration level. There are methods, most of them based on the work of Kerschen et al. [5]. These methods require significant computation times. In many industrial studies, Numerical Modal Analysis are more and more performed before Experimental Modal Analysis. Thus, expected frequencies, damping and mode shapes are used to optimize experimental parameters in the acquisition system, sensors and measurement point location.
The present study aims to identify in real time nonlinear modal parameters in the case of weak nonlinearities. The Kinematic model used is based on the numerical modal basis and is assumed to not depend on vibration amplitude. We propose to use the framework of data assimilation. Data assimilation is a family of methods which allows to use a model with data in a stochastic framework [6].
In order to perform real time identification, we use a sequential assimilation method known in the signal processing domains as Kalman filters. This work is specifically focusing on nonlinear Kalman filters. Firstly introduced in the early sixties [7], this promising technique for estimation with a linear model designed by Rudolf Kalman was not well accepted [8] but quickly became a very used algorithm until now. Not to ease the bibliographic work, the filter has been improved in a lot of different way and domains, in order to deal with a large variety of problems. Indeed, Kalman filter is not only the original algorithm, but also it has become a family of algorithms. In order to go beyond the linear framework of the Kalman filter, Stanley Schmidt developed in a NASA context an Extended Kalman Filter (EKF) [9] developed decades later in a civil context [10] based on a linearization of a nonlinear model. From this filter has derived a lot of references on multiple domains: ballistic, chemical reactions control, aerospace, robotic [11,12]. In the particular field of dynamics, EKF has been widely used for tracking specific model parameters in order to do health monitoring [13]. In the EMA framework, linear Kalman filter was used to estimate simulated vibrating forces [14] following by the EKF for estimating simulated input forces acting on structural systems [15]. Other approaches use data driven stochastic subspace identification (SSIDATA) in order to mix computational and structural parameters in the identification results. The disadvantage of the SSI methods is the use of computational resources, which is difficult to transpose in a real time framework.
Frequency tracking is not a new trend. The real time framework, the objectives of non linear identification and the expected timefrequency accuracy stop us from using Fourier Analysis Methods. But this framework has been tackled with Auto Regressive Moving Average (ARMA models) [16,17] with a drawback on the complexity and robustness of the identification process in the case of nonlinear systems. Different methods from the optimal estimation framework [18] are already employed to track frequency. For examplea monitoring vibration approach is applied on a gearbox, providing alert indicators using an EKF coupled with autoregressive models [19]. The system is robust and effective to identify optimal model order. However some false alerts are generated by this method and the system is not designed to use the whole modal information. The specific topic of modal parameters estimation is very dynamic and a lot of different recent works use the optimal estimation framework.
Nowadays, some authors points out the importance of the experimental extraction of nonlinear modes to model systems or characterize the system dynamic [20]. Yang et al. [21] is using high speed videos of structures with a video magnification to amplify the displacement. Then, a blind source separation is performed to extract the modal parameters, but in a linear context. Abdollahpouri et al. [22] compare EKF and Moving Horizon Estimation to tackle real time estimation but the estimation is limited to one mode. Dzunic et al. [23] use Bayesian Statespace (BSS) approach to estimate the probability of defect occurring in a structure. The BSS formalism can be used in realtime, but the computation of the probability distributions is expensive. Nonlinear version of Kalman filters needs less computational time. Using those promising methods, Dzunic et al. [24] use an EKF for identifying forces input in a structural system using a classical random walk model. This approach implements directly a discretized version of the classical differential system as a model and follows the framework developed by Chatzi [13] in the structure health monitoring field. The results propose only the estimation of the force.
A different approach using Kalman filtering consists in performing a modal demodulation model in the EKF for accurate measurements of non stationary natural frequencies and modal damping [25]. However observations are based on 1D sensors and the proposed algorithm is built on Extended Kalman Filter Series, with no link to the structure and its eigenvector basis. Cha et al. [26] use another nonlinear version called Unscented Kalman Filter and a model of the expected signal response to estimate structural properties of the structure and the input force. This approach does not use a modal context which allows several modes estimation and even if the model used is nonlinear, the estimation is performed on a linear structure. Other recent approaches use demodulation techniques with neural networks to identify nonlinear modes but for a single frequency response function [27].
The proposed method based on sequential data assimilation is developed in Section 2 with the description of the modal model generalized in a EKF for NDimensional observations. The purpose of this article is to develop a real time modal analysis for weakly nonlinear structures based on an EKF and fused contactless measures. On the tracks of identification with sequential data assimilation as Kalman filters using nonlinear models [28], we use a modal framework for modeling the input data. The method presented in this article is at the centre of the measurement/processing chain. It allows in the targeted applications to combine different types of sensors while offering fast information processing.
The system is able to identify in a real time scheme the different nonlinear parameters of a structure modal model for each vibration eigenmode and for transient observations: frequency, magnitude and damping. It is using a Reduced Order Model based on the modal basis of the structure. The experimental procedure is using data from high speed camera and laser. The application test cases are described in Section 3 with a validation on a numerical test case and an experimental one with geometrical nonlinearities. Finally, in Section 4 both numerical and experimental results are given for nonlinear simulation and discussed for the nonlinear simulation and the real measurements acquired with the experimental setup.
2 Sequential assimilation in a modal framework
Data assimilation is very well described by the elegant formula from the geoscience fields: “Data assimilation is the science of successful compromises” [6], compromises between both simulation and experimental worlds. Developed since the thirties in the meteorology field, these methods are generating an increasing interest in a lot of different domain following the data driven philosophy.
Data assimilation groups two main types of methods:

Variational methods use data on an interval including past and future information regarding the time where estimation is performed. The most used method in this case is the 4DVar method [29].

Sequential methods use only past information. These methods are based on Kalman filters algorithms to assimilate the model with data.
The Extended Kalman Filter, as described in Dion et al. [25] is robustly designed to track sine component signals. In order to adapt the method to Ndimensional measurement, we have to set up a spatial relationship between the different observed points according to the time vision of the sinus tracking. Section 2.1 describes the system of equations. Extended Kalman Filter equations and state system employed are introduced in Section 2.2 and Section 2.3.
2.1 Modal model in a weak nonlinearity framework
A vibrating system can be written as : (1)
These equations describe the time and space relations for the general coordinates of the system described by their position x, speed ẋ and acceleration ẍ. M is the mass matrix, K and C are the stiffness and damping matrix. F_{ext} is modeling the external forces and F_{NL} the nonlinear forces depending on position and speed. ν is modeling the uncertainty of the model. This uncertainty is assumed to be unbiased and Gaussian, with zero means and a covariance matrix R_{ν}.
In the linear context of modal analysis the deterministic system can be written in the frequency domain as: (2)
The solutions of the system (Eq. (2)) can structurally be decoupled in time and space. Thus, the solution can be decomposed on a modal basis depending on the structure depending only on the space. The mode index i ∈ ⟦1, ..., n⟧ is in superscript for the consistency of the following. Different important underlying hypotheses have to be pointed out:

At any time, the shape function is a linear combination of mode shapes.

Instantaneous natural frequency and damping depend on the modal amplitude of the corresponding mode.
From those, two important assumptions can be made:

The modal base used is assumed to be strictly real (without any phase between nodes for each natural mode).

The systemis in the weak nonlinear framework [30]: the eigenvectors are assumed to be time invariant.
In the case of free oscillations, the solution can be written as a shape function S(x, y, z, t) under the form:
In the previous equations f^{i}(t) is representing the frequency, ϕ^{i} the phase, ξ^{i}(t) the damping and a^{i} the initial mode coefficient for mode i. ν includes the uncertainty of the model but also the rest of the modal basis in the case of a truncated modal basis (reduced order model). We call ν the residual and we verify in the last section that this residual model given in the above equation is verified. μ is modeling the uncertainty.
The model and observation function derive from this general model and are given in Section 2.3 while the Kalman framework is introduced first in Section 2.2.
2.2 The extended Kalman filter
This section describes assumptions and the retained set of equations for the Kalman filter. Let’s consider a classical nonlinear state system with a time evolutive equation and an observation equation: (7)
In these equations, X_{k} is the state vector at step k, mirroring the discrete version of the continuous state version x(t). The function f_{c} and its discretized version f models the system evolution with a process noise w(t) or w_{k}. The function h_{c} or its discretized version h is the observation function. It links the state variable space with the measurement space with an observation noise v(t) or v_{k}.
Kalman filters are part of the largest class of Data Assimilation algorithms. Data assimilation groups the methods used to fit models with real data in order to do prediction or identification. Kalman filters belong to the class of sequential algorithms and uses the two first statistical moments, the means and covariances of a variable vector X and an evolutive state system (Eq. (7)) to compare real data with an input model.
The original Kalman filter [7] estimates the probability distribution of X with the functions f and h defined linear (for the sake of clarity, f has no link with F_{NL} and F_{ext} introduced in Eq. (1)). Defining f_{k} and h_{k} two invariant matrix as f(X) = f_{k}X and h(X) = h_{k}X, the linear equation can be expressed in a twostep process. First, the prediction step, which uses the evolution part of the equation (7) to predict an estimation of the future state for mean and covariance P_{kk−1} based on their past state and P_{k−1k−1}
Kalman filter introduces Q_{k}, which is the covariance of the process noise w_{k} supposed to be Gaussian and centered.
The second step is the update, during which the prediction is compared to the observation using the observation part of the equation (7).
These equations introduce K_{k} the Kalman gain and R_{k} the covariance of the observation noise v_{k} supposed to be Gaussian and centered. As we can see in equation (10), the strength of this class of methods is to use a gain driven by the covariances to adapt the state vector to the observations.
Unfortunately, the linear algorithm is not sufficient to characterize the distributions in nonlinear cases. The Extended Kalman filter tackles this problem by linearizing the functions at each step. It uses the nonlinear state equations (Eq. (7)) to propagate the means and introduces the Jacobian matrix F_{k} and H_{k} derived from the functions f and h linearized at step k to propagate the covariances.
The complete extended Kalman filter equations with linearization of the nonlinear functions f and h are then shown below.
The Extended Kalman Filter has several drawbacks. Its implementation is not easy because of the complexity of the jacobian calculus. The jacobian drives up the computational cost of the EKF compared to a standard Kalman for example. Another drawback caused by the linearization of the model is the robustness in the case of high nonlinearity. Indeed EKF induces process errors because of the difference between the curve and the linearized projection: those errors grows with the nonlinearity of the function for a fixed step.
Those errors are also important to tune the filter. The initialization is not difficult. The P_{0} matrix is defined diagonal with the squared variance for each state variable. It can be easily transposed by the experimenter as an error interval allowed around the chosen X_{0} value. The R_{k} value is defining the confidence on observation. It can be linked with the precision of observations in the same way than the P_{0} value. Q_{k} value represents the error of the model. This error includes linearization error and modeling error.
Section 2.1 describes the modal analysis framework. The model is based on an invariant (linear) modal basis and is designed in order to track weak nonlinearities that are observed through the evolution of the natural frequencies and damping. These weak nonlinearities of the model allow to use EKF: only natural frequencies and modal damping are time varying. Moreover amplitude and frequency variations are assumed to be much slower than studied vibrations: observed signals can be depicted as narrow band signals.
Section 2.3 describes the state system derived from the modal model in Section 2.1 and used to track modal parameters of a structure.
2.3 State system
This section introduces the design of the state system used in the EKF algorithm.
The design of the evolution function matrix has been defined by Dion et al. [25] for the tracking a sine components in a signal. The general form of the solution given in equation (3) can be split in two parts: a time part and a space part. For the specific mode i, the time part is defined as: (20)
A common solution to model the signal is to use analytic signal based on the Hilbert transform. However the Hilbert transform induces some bias when implemented and the approximation is correct only under the Bedrosian theorem first condition [31], which is commonly called conditions of narrow band signal. This assumption is often well defined in telecommunication domain, but can be more tricky in identification or tracking for complex signals [32]. This issue is a current investigation question, and recent works try to extend the Hilbert transform without the Bedrosian condition [33]. In our case, amplitude and frequency evolutions given in equation (20) are slow considering the signal, which allows to satisfy the narrow band conditions.
In other terms, studied signals can be described with in equation (20):
Following the narrowband definition, we define the carrier and phase frequencies and for the ith mode. The m(t) function represents the bandwidth modulation of the signal. This amplitude and frequency modulations implies a last condition already verified regarding the definition given in equation (3), but important to mention: (25)
In a first approach, the pseudo harmonic signal can be set into an analytical signal with the following discrete version (the imaginary part is the Hilbert transform of the original signal): (26)
Considering that the parameters α^{i} and f^{i} are varying slightly over time: (27)
Then, we have the following state form : (28)
Separating real part and imaginary part: (29)
The state system becomes: (30)
If we take into account the frequency modulation, the state system becomes with notation from Section 2.2:
The evolutions of the amplitude and the frequency are slow regarding the time step. The state system is nonlinear (Eq. (14)) and W_{k} the process noise is centered and Gaussian with its covariance defined as Q_{k} in Section 2.2.
The following space part of the state system is one of the key points introduce in this article. This part is significant to introduce multiple observations. These observations could come from multiple sensors or from processed digital images. The observation function link the modal variables of the state system to the observed measurements. These link is performed with the modal basis. The discrete form of the space is defined by the set of measurement points (sensors) such as .
To deal with n modes, we concatenate vertically the different modal variables and define the block matrix evolution as: (34)
The observation from the sensors gives different discretized measures of shape functions S_{k,p} : (35)
The observation function has to be designed in order to transform the state vector to the model space. This model space is defined by the equation (3): this is the sum of the n first modes contribution at each time step.
The modal basis is used in the observation equation in order to link the state variable with the measurements: (38)
This new form is particularly designed for free vibrations of structures measured with la large set of sensors. The next section describes the implementation of the previous model.
3 Experimental setup
This section describes the experimental setup we use to validate the theoretical development of the previous part. First, the test case chosen to prove the feasibility of the theoretical concept is introduced: a classical cantiveler beam (Sect. 3.1). Then, the experimental setup is described in Section 3.2 in order to validate the Kinematic SAMI on a real test case. We choose to measure the cantilever beam with a high speed video acquisition.
3.1 Application on a case study: the cantilever beam
We propose an experimental application with contactless measurements of a structure with geometrical nonlinearity in the modal analysis framework. In order to test the different parts of the estimation process described below, an experimental validation on a classical cantilever beam is proposed. Only bending modes are studied which means that the beam is considered in the 2D plane (e_{x}, e_{z}) (see Fig. 1). According to the Euler Bernoulli theory, the bending motion is assumed to be only along the e_{x} axis and displacements along e_{z} axis are neglected. In order to deal with all the cases, three tests cases are presented:
 1.
A numerical simulation composed with 3 modes whose frequencies and damping are varying: the nonlinear case study. Three variables per mode will be identified along time: the modal magnitude, the damping coefficient and the frequency. One mode is hardening and two are softening ones.
 2.
A real test case described in the Section 3.2 and excited by a shock. Measurements are performed with a high speed camera and with specific marks on the beam. The camera position allows to neglect the depth and to consider the image processing of the beam in a 2D plane (Fig. 1). The evolution of the positions of each marker is extracted with a video processing algorithm.
 3.
In the same experimental test case, another sensor is added: displacement measurements measured with a laser on one point of the cantilever beam.
Fig. 1 Experimental setup. 
3.2 Experimental setup
The modal basis of the aluminium alloy beam is obtained in accordance with the EulerBernoulli theory.
Considering the 1D modal basis of this classical test case , the cantilever beam solution S(x, t) is: (39)
The geometric and mechanical properties have been chosen regarding the number of modes expected in the observation. Table 1 presents the properties of the beam. The theoretical first five mode frequencies are given in the Table 2. The clamping is built with steel block (see Fig. 1), not as ideal as the EulerBernoulli assumptions. However, the displacement induced by the non ideal clamping is negligible compared to the bending displacement amplitudes observed.
In this first part, the experimental setup is composed of three elements:

The high speed camera;

the clamped free beam;

the spotlight.
Using aluminum in the visual field brings a major disadvantage: its specular properties. Besides, there is no particular position of the light and the cantilever beam to avoid reflection stray light. This issue has been tackled by using specific pattern placed every centimeter and providing 45 observation points for the estimation (Fig. 1). The measures are extracted from the video using a specific method based on the tracking of interest points [34].
The camera is calibrated using the method proposed by Zhang [35] implemented in MATLAB. The pixel size projected on the experimental device (called Ground Sample Distance or GSD the remote sensing field) is 108 × 10^{−6} m and is presented in Section 4.4. The measures are processed by our algorithm and then compared to a classical Fourier analysis of each observation point.
Properties of the cantilever beam.
4 Numerical investigations and experimental results
First Section 4.1 defines the criteria for evaluating the performance of the method and the tuning of the different parameters used.
4.1 Criteria for method evaluation
The model introduced in Section 3.1 is used to simulate a numerical test bench. This linear model is computed in order to extract mode shapes. The assumption of weak nonlinearities allows using these modes shapes with nonlinear natural frequencies and dampings. Then a nonlinear simulation is proposed, introducing variations of the frequencies (as introduced in Eq. (3)). An important noise is added on observations in order to generate a realistic and severe test for the proposed method. This noise is satisfying two hypothesis: the noise is considered Gaussian centered and the noise is considered to be additive.
To quantify the convergence of the filter, the error will be measured regarding each variables. A classical Root Square Mean Error (RMSE) residual estimator is used: (40)
Indeed, the RMSE gap between the acquisition data and the model output projected on the observation space is very common in the Data Assimilation domain. In our case, we compute a ratio between RMSE and the measures in order to compare the different extracted modes through a percent value. For example for the frequency: (41)
The constant parameters are extracted from the final value of the output filters and compared to the ground truth value in the case of the simulations. Finally, a special attention is focused on the residual for the real case. According to the modal decomposition in equation (3), it is interesting to show that the residual is composed of the sum of the non identified modes and the noise.
We choose to test the algorithm on a usual case of 3 modes identification. The simulation is based on the theoretical modes given in the Table 2. The performed during 5 s with a time step of Δt =5 × 10^{−6} s. A white and Gaussian noise (standard deviation σ_{sim} = 200 × 10^{−6} m) is added to the model equation (39) used to simulate the beam shape evolution over time. The spatial frequency is chosen very high for the ground truth with 1000 points, whereas the spatial frequency of the data simulated for the filter input is sampled to 25 points. The algorithm is calibrated first on a linear test case with constant frequencies.
Theoretical frequencies of the cantilever beam modes.
4.2 Nonlinear numerical case study
Nonlinearities are introduced on natural frequencies and dampings. Three modes are studied, one mode is hardening and two are softening nonlinearities are larger than classical structures in order to assess the method used.
The results are presented in Figure 2. The simulation values of the reference variables are in a red dashline. The identified variables are in blue continuous line. Multiples of the covariances are in green around the different parameters.
The results are convincing: the identification process is able to track the frequency and the envelop in a real time scheme. The envelop gives access to the time evolution of the damping coefficient, which allows to characterize completely the observed structure. Moreover, it is interesting to point out that the covariance evolves on the opposite expected behavior: instead of converging, the covariance seems to grow with time. The different modes amplitude are decreasing, generally as fast as the mode number is high. The filter confidence in the higher modes is then decreasing with time due to the observed amplitude become smaller and is coming closer to the noise, which explains the increasing covariance.
We choose to display the frequency and damping error values compared to the simulation values on Figure Figure 3a. The values are evolving with time, and here we propose to display a percentage from the true values at each time. The identification of these two parameters is better than 2%. It is interesting to underline the oscillation behavior of the different results Figures 2 and 3a. This behavior is clearly induced by the first mode and it can be observed on the other curves in smaller proportions: this is the consequence of the approximation of the Bedrosian theorem. The narrow band assumption is not completely verified.
The RMSE for this simulation is given in Figure 3b. In this numerical test case, the perfect measurement RMSE can be displayed, this is not the case for the experimental data in Section 4.3. The RMSE converges towards the noise introduced in the numerical test case (end of the continuous line on Fig. 3b).
These results highlights the robustness of the method in the case of non stationary frequency evolution. The next part is introducing real measures acquired with a high speed camera.
Fig. 2 Results for identification on a nonlinear case study. 
Fig. 3 Error evolution for each mode of the real time identification of the different modes of the numerical test case. 
4.3 Real time experimental data
4.3.1 Results on data from high speed video
The Fourier analysis (Fig. 4) show the first four natural frequencies which are compared to the identified natural frequencies Table 3. The resolution of the Fourier analysis is 0.87 Hz.
The three first modes envelop and frequency identification with the standard deviation are displayed in Figure 5.
In order to compare the results with the previous simulated ones we propose to display the RMSE but also the probability density function (PDF) of the centered errors on Figure 6. Figure 6a shows that the filter is minimizing the errors, and that the mean error level at the end of the signal is about 1 × 10^{−5} m is largely smaller than the GSD 1.08 × 10^{−4} m. Figure 6b allows to validate the Gaussian assumption used for the Kalman filter. The noise deduced from modal magnitudes is also Gaussian regardless the number of identified modes.
The results obtained are convincing in different ways. The observed parameters are invariant: the small displacements of the cantilever beam allow to keep a linear approach. Figure 6a shows that the noise chosen for the simulation is very high regarding to the real case. The identification process is performed with space resolution smaller than 1∕10 of pixel resolution for vibration amplitudes. Another interesting point is that the identification process do not need to be initialized with parameters close to the good results. During the first 0.1 s the identification process is deeply disturbed before and during the shock, but converges as soon as the signals are significant regarding the noise amplitudes.
The realtime performance results are depicted in Figure 7 with the Kinematic SAMI prototyped in MatLab^{®} language. Even if this code prototype can be improved, these results highlight the efficiency of the proposed tool for real time identification of non linear modal parameters of most of classical structures with modes in the 0 kHz–1 kHz bandwidth. The results can be seen in Figure 7.
For the sake of clarity, this article is only focusing on the signal processing part and not on the video processing part. The code is executed in a sequential way in order to simulate a real time sequential acquisition. These results could be optimized later on in a realtime execution environment. The mean is varying from 1500 Hz to 5000 Hz^{1}. The refresh rate depends mainly on the computing time of the innovation covariance inversion (88.6%). As the figure is not repeatable, we assume that the variation of level observed are due to the operating system activity. This frequency is high enough for MatLab^{®} code to consider real time application applications with sample rate smaller than 1000 Hz (fps).
Resonant modes according to Fourier analysis.
Fig. 4 Fourier Magnitude for the experimental test case data. 
Fig. 5 Results for identification on an experimental test case. 
Fig. 6 Two different ways to present the errors: the RMSE function of time and a centered probability density depending of the number of modes identified. 
Fig. 7 Refresh frequency evolution function of time. 
4.3.2 Residual analysis
The residual analysis allows to better understand the filtering process by analyzing the different contributions of the modes in the residual. Figure 8 display an absolute and normalized representation of the residual in space.
Figure 8 shows that the absolute residual has the same shape than the third mode in the case of the tracking of 2 modes. For 3 modes identification, the residual has a lower absolute error level and its space shape is not containing the third mode anymore: this experiment shows that the residual is composed of the sum of the different modes not taken into account in the reduced model. To end this residual analysis, we propose to track the fourth mode. The result is very promising because the method is able to track a very small modal amplitudes, as we can see in Figure 4. In term of residual shape, the fourth mode has a very small contribution, but can be seen with the change observed at the half of the shape residual between the 3 modes and 4 modes identifications in Figure 8. Thus, the residual shape is also an accurate tool for identifying boundary condition problems: the error is concentrated close to the clamp and highlights the difficult task to perform a perfect clamp.
Fig. 8 Space residual display with identified mode. 
5 Conclusion
In this paper, a novel method based on data assimilation has been introduced for applications on the identification of linear or nonlinear modal parameters. The method called Kinematic SAMI is designed for a real time identification of the frequencies and damping of a structure excited by shock, and is based on modal projection (time and space) of measurements performed with multisensors. This paper proposes specifically a real time application.
The identification method is validated first on a nonlinear system simulation and second on multiple measure points setup. This real test case is performed with high speed camera acquisition and video processing extraction on a cantilever beam. A specific residual analysis shows the efficiency of the method in the identification process for weak nonlinear modes.
Nomenclature
Symbol  Definition  Unit 
a^{i}  Initial mode i coefficient  m 
Time depending mode i coefficient  m  
C  Damping matrix  kg s^{−1} 
(e_{x}, e_{y}, e_{z})  Space basis  
F  Evolution function  
F_{ext}  External Forces  N 
F_{NL}  Nonlinear Forces  N 
f^{i}  Frequency of the mode i  Hz 
f_{p}  Carrier frequency  Hz 
f_{Δ}  Phase frequency  Hz 
H  Observation function  
k  Step time index  
K  Stiffness matrix  kg s^{−2} 
M  Mass matrix  kg 
m(t)  Bandwidth modulation of the signal  
P_{kk−1}  Covariance of state vector at step k knowing step k − 1  
Q_{k}  Process noise covariance  
R_{ν}  Covariance matrix of ν  N 
S  Shape function depending of the 3 axis position variables  m 
t  Time  s 
Generalized coordinate vector  m  
V^{i}  Temporal modal contribution of mode i  m 
Hilbert transform of V^{i}  
v_{k}  Observation noise (vector)  m 
w_{k}  Process noise (vector)  
X_{k}  State vector at step k  
x  x position  m 
ẋ  Speed on x axis  m s^{−1} 
y  y position  m 
z  z position  m 
Z_{k}  Observation vector  
Δt  Step time t = k ⋅ Δt  s 
ν  Uncertainty of the model  N 
μ  Uncertainty of the model  N 
Φ  Modal basis  
ϕ^{i}  Phase of the mode i  m 
ω  System Pulsation  rad s^{−1} 
σ_{sim}  Standard deviation  m 
ξ^{i}  Damping of the mode i 
Acknowledgements
This research is funded by a Ph.D. grant of the French National Technological Research Agency (ANRT) and VannierKinoptik, a french company specialized in high speed cameras through the FAst MOving SYStem (FAMOSYS) project.
References
 N.M.M. Maia, J.M.M. Silva, Theoretical and Experimental Modal Analysis, Engineering Dynamics Series, Research Studies Press, Boston, 1997 [Google Scholar]
 D.J. Ewins, Modal Testing: Theory, Practice, and Application, Mechanical Engineering Research Studies: Engineering Dynamics Series, Research Studies Press, Boston, 2000 [Google Scholar]
 G. Bissinger, D. Oliver, 3D laser vibrometry on legendary old Italian violins, Sound Vib. 41, 10–15 (2007) [Google Scholar]
 H. Marschner, Fritz Rischbieter, ThreeDimensional Operational Deflection Shape Analysis of Squealing Disc Brakes, in SAE Technical Paper, SAE International, October 2004. [Google Scholar]
 G. Kerschen, M. Peeters, J.C. Golinval, C. Stéphan, Nonlinear modal analysis of a fullscale aircraft, J. Aircraft 50, 1409–1419 (2013) [CrossRef] [Google Scholar]
 E. Blayo, M. Bocquet, J. Vernon, L’assimilation de données, un outil de synthèse de l’information, June 9 [Google Scholar]
 R.E. Kalman, A new approach to linear filtering and prediction problems, J. Basic Eng. 82, 82–35 (1960) [Google Scholar]
 R.E. Kalman, Contributions to the theory of optimal control, Bol. Soc. Mat. Mex. 5, 5–102 (1960) [Google Scholar]
 G.L. Smith, S.F. Schmidt, L.A. McGee, Application of statistical filter theory to the optimal estimation of position and velocity on board a circumlunar vehicle. Technical Report R135, National Aeronautics and Space Administration, 1962 [Google Scholar]
 Analytic Sciences Corporation and A. Gelb, Applied Optimal Estimation, M.I.T. Press, Cambridge, MA, 1974 [Google Scholar]
 G.M. Siouris, G. Chen, J. Wang, Tracking an incoming ballistic missile using an extended interval Kalman filter, IEEE Trans. Aerosp. Electron. Syst. 33, 33–232 (1997) [Google Scholar]
 G.P. Huang, A.I. Mourikis, S.I. Roumeliotis, Analysis and improvement of the consistency of extended Kalman filter based SLAM, in IEEE International Conferenc on Robotics and Automation, 2008, pp. 473–479 [Google Scholar]
 S.E. Azam, E. Chatzi, C. Papadimitriou, A. Smyth, Experimental validation of the Kalmantype filters for online and realtime state and input estimation. J. Vib. Control 23, 2494–2519 (2015) [Google Scholar]
 C.K. Ma, D.C. Lin, J.M. Chang, Estimation of forces generated by a machine mounted upon isolators under operating conditions. J. Franklin Inst. 336, 875–892 (1999) [Google Scholar]
 C.K. Ma, C.C. Ho, An inverse method for the estimation of input forces acting on nonlinear structural systems. J. Sound Vib. 275, 953–971 (2004) [Google Scholar]
 P.J. Kootsookos, A review of the frequency estimation and tracking problems, 1993 [Google Scholar]
 J. Antoni, L. Garibaldi, S. Marchesiello, M. Sidhamed, New separation techniques for outputonly modal analysis. Shock Vib. 11, 227–242 (2004) [CrossRef] [Google Scholar]
 D. Simon, Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches, WileyInterscience, New York, 2006 [CrossRef] [Google Scholar]
 Y. Shao, C.K. Mechefske, Gearbox vibration monitoring using extended Kalman filters and hypothesis tests, J. Sound Vib. 325, 325–629 (2009) [Google Scholar]
 D.A. Ehrhardt, M.S. Allen, Measurement of nonlinear normal modes using multiharmonic stepped force appropriation and free decay. Mech. Syst. Signal Process. 7677, 612–633 (2016) [Google Scholar]
 Y. Yang, C. Dorn, T. Mancini, Z. Talken, G. Kenyon, C. Farrar, D. Mascareñas, Blind identification of fullfield vibration modes from video measurements with phasebased video motion magnification, Mech. Syst. Signal Process. 85, 85–567 (2017) [Google Scholar]
 M. Abdollahpouri, G. Takács, B. RohaľIlkiv, Realtime moving horizon estimation for a vibrating active cantilever, Mech. Syst. Signal Process. 86, 86–1 (2017) [Google Scholar]
 Z. Dzunic, J.G. Chen, H. Mobahi, O. Büyüköztürk, J.W. Fisher, A Bayesian statespace approach for damage detection and classification. Mech. Syst. Signal Process. 96, 239–259 (2017) [Google Scholar]
 F. Naets, F. Cosco, W. Desmet, An extended Kalman filter approach for augmented strain/stress visualization in mechanical systems, in 2014 IEEE/ASME 10th International Conference on Mechatronic and Embedded Systems and Applications (MESA), September 2014 pp. 1–6 [Google Scholar]
 J.L. Dion, C. Stephan, G. Chevallier, H. Festjens, Tracking and removing modulated sinusoidal components: A solution based on the kurtosis and the Extended Kalman Filter, Mech. Syst. Signal Process. 38, 38–428 (2013) [Google Scholar]
 Y.J. Cha, J.G. Chen, O. Büyüköztürk, Outputonly computer vision based damage detection using phasebased optical flow and unscented Kalman filters. Eng. Struct. 132, 300–313 (2017) [Google Scholar]
 V. Ondra, I.A. Sever, C.W. Schwingshackl, A method for detection and characterisation of structural nonlinearities using the Hilbert transform and neural networks, Mech. Syst. Signal Process. 83, 83–210 (2017) [Google Scholar]
 A. Goeller, J.L. Dion, R.L. Breton, T. Soriano, B. Roux, Dynamic system stochastic identification mixed with video processing: Validation on a real case, in Mechatronics (MECATRONICS)/11th FranceJapan & 9th EuropeAsia Congress & 17th International Conference on Research and Education in Mechatronics (REM), 2016, pp. 146–151 [Google Scholar]
 M. Bocquet, Introduction to the principles and methods of data assimilation in geosciences, Technical report, École des Ponts ParisTech, February 2014 [Google Scholar]
 N. Peyret, J.L. Dion, G. Chevallier, A framework for backbone experimental tracking: Piezoelectric actuators, stopsine signal and Kalman filtering. Mech. Syst. Signal Process. 78, 28–42 (2016) [Google Scholar]
 E. Bedrosian, A product theorem for Hilbert transforms, Proc. IEEE 51, 51–868 (1963) [CrossRef] [Google Scholar]
 C. Pachaud, T. Gerber, M. Firla, N. Martin, C. Mailhes, Consequences of nonrespect of the Bedrosian theorem when demodulating, in The Tenth International Conference on Condition Monitoring and Machinery Failure Prevention Technologies (CM2013), 2013 [Google Scholar]
 M.R. Shahriar, P. Borghesani, R.B. Randall, A.C.C. Tan, An assessment of envelopebased demodulation in case of proximity of carrier and modulation frequencies, Mech. Syst. Signal Process. 96, 96–176 (2017) [Google Scholar]
 A. Goeller, Contribution à La Perception Augmentée de Scènes Dynamiques : Schémas Temps Réels d’assimilation de Données Pour La Mécanique Du Solide et Des Structures. PhD thesis, 2018 [Google Scholar]
 Z. Zhang, A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22, 22–1330 (2000) [Google Scholar]
Cite this article as: A. Goeller, J.L. Dion, R.L. Breton, T. Soriano, Kinematic SAMI : a new realtime multisensor data assimilation strategy for nonlinear modal identification, Mechanics & Industry 21, 413 (2020)
All Tables
All Figures
Fig. 1 Experimental setup. 

In the text 
Fig. 2 Results for identification on a nonlinear case study. 

In the text 
Fig. 3 Error evolution for each mode of the real time identification of the different modes of the numerical test case. 

In the text 
Fig. 4 Fourier Magnitude for the experimental test case data. 

In the text 
Fig. 5 Results for identification on an experimental test case. 

In the text 
Fig. 6 Two different ways to present the errors: the RMSE function of time and a centered probability density depending of the number of modes identified. 

In the text 
Fig. 7 Refresh frequency evolution function of time. 

In the text 
Fig. 8 Space residual display with identified mode. 

In the text 
Current usage metrics show cumulative count of Article Views (fulltext article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 4896 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.