Christopher Onyema Arimie^1*, Iheanyi Sylvester Iwueze², Maxwell Azubuike Ijomah¹, Elechi Onyemachi^2
1Department of Mathematics and Statistics, University of Portharcourt, Portharcourt, Nigeria.
²Department of Statistics, Federal University of Technology, Owerri, Nigeria.
DOI: 10.4236/ojs.2018.83037   PDF    HTML   XML   979 Downloads   2,527 Views   Citations

Abstract

The linear Gaussian white noise process (LGWNP) is an independent and identically distributed (iid) sequence with zero mean and finite variance with distribution . Some processes, such as the simple bilinear white noise process (SBWNP), have the same covariance structure like the LGWNP. How can these two processes be distinguished and/or compared? If is a realization of the SBWNP. This paper studies in detail the covariance structure of . It is shown from this study that; 1) the covariance structure of is non-normal with distribution equivalent to the linear ARMA(2, 1) model; 2) the covariance structure of is iid; 3) the variance of can be used for comparison of SBWNP and LGWNP.

Keywords

White Noise Process, Normality, Stationarity, Invertibility, Covariance Structure

Share and Cite:

1. Introduction

A stochastic process $X_{\text{}t},t\in Z$ , where $Z=\left\{\cdots ,-1,0,1,\cdots \right\}$ is called a white noise or purely random process, if with finite mean and finite variance, all the autocovariances are zero except at lag zero. In many applications, $X_{\text{}t},t\in Z$ is assumed to be normally distributed with mean zero and variance, ${\sigma }^{\text{}2}<\infty$ , and the series is called a linear Gaussian white noise process with the following properties [1] - [7] .

$E\left(X_{\text{}t}\right)=\mu$ (1.1)

$R\left(0\right)=\mathrm{var}\left(X_{\text{}t}\right)=E\left(X_t-\mu \right)={\sigma }^{\text{}2}$ (1.2)

$R\left(k\right)=\mathrm{cov}\left(X_t,X_{t+k}\right)=E\left[\left(X_t-\mu \right)\left(X_{t+k}-\mu \right)\right]=\{\begin{array}{l}{\sigma }^{\text{}2},k=0\\ 0,\text{otherwise}\end{array}$ (1.3)

$\rho \left(k\right)=\text{corr}\left(X_t,X_{t+k}\right)=\frac{R\left(k\right)}{R\left(0\right)}=\{\begin{array}{l}1,\text{}k=0\\ 0,\text{otherwise}\end{array}$ (1.4)

${\varphi }_{\text{}kk}=\text{corr}\left(X_{\text{}t},X_{\text{}t+k}/X_{\text{}t+1},X_{\text{}t+2},\cdots ,X_{\text{}t+k-1}\right)=0\forall k$ (1.5)

where R(k) is the autocovariance function at lag k, r_k is the autocorrelation function at lag k and ${\varphi }_{\text{}kk}$ is the partial autocorrelation function at lag k.

In other words, a stochastic process $X_{\text{}t},t\in Z$ is called a linear Gaussian white noise if $X_{\text{}t},t\in Z$ is a sequence of independent and identically distributed (iid) random variables with finite mean and finite variance. Under the assumption that the sample $X_{\text{}1},X_{\text{}2},\cdots ,X_{\text{}n}$ is an iid sequence, we compute the sample autocorrelations as

${\hat{\rho }}_X\left(k\right)=\frac{{\displaystyle \underset{t=1}{\overset{n}{\sum }}\left(X_t-\bar{X}\right)\left(X_{\text{}t+k}-\bar{X}\right)}}{{\displaystyle \underset{t=1}{\overset{n}{\sum }}{\left(X_{\text{}t}-\bar{X}\right)}^{\text{}2}}}$ (1.6)

where

$\bar{X}=\frac{1}{n}{\displaystyle \underset{i=1}{\overset{n}{\sum }}{X}_t}$ (1.7)

The iid hypothesis is always tested with the Ljung and Box [8] statistic

$Q_{\text{}LB}\left(m\right)=n\left(n+2\right){\displaystyle \underset{k=1}{\overset{m}{\sum }}\left(\frac{{\left[{\hat{\rho }}_{\text{}X}\left(k\right)\right]}^2}{n-k}\right)}$ (1.8)

where $Q_{\text{}LB}\left(m\right)$ is asymptotically a chi-squared random variable with m degree of freedom.

Several values of m are often used and simulation studies suggest that the choice of $m\approx \ln \left(n\right)$ provides better power performance [9] .

If the data are iid, the squared data $X_1^2,X_2^2,\cdots ,X_n^2$ are also iid [10] . Another portmanteau test formulated by Mcleod and Li [10] is based on the same statistic used for the Ljung and Box [8]

$Q_{\text{}ML}\left(m\right)=n\left(n+2\right){\displaystyle \underset{k=1}{\overset{m}{\sum }}\left(\frac{{\left[{\hat{\rho }}_{\text{}{X}^2}\left(k\right)\right]}^2}{n-k}\right)}$ (1.9)

where the sample autocorrelations of the data are replaced by the sample autocorrelations of the squared data, ${\hat{\rho }}_{\text{}{X}^{\text{}2}}\left(k\right)$ .

As noted by Iwueze et al. [11] , a stochastic process $X_{\text{}t},t\in Z$ may have the covariance structure (1.1) through (1.5) even when it is not the linear Gaussian white noise process. Iwueze et al. [11] provided additional properties of the linear Gaussian white noise process for proper identification and characterization from other processes with similar covariance structure (1.1) through (1.5).

Let $Y_t=X_t^d,d=1,2,3,\cdots$ where $X_{\text{}t},t\in Z$ , be the linear Gaussian white noise process, the mean $\left[E\left(Y_{\text{}t}\right)=E\left(X_t^d\right)\right]$ , the variance $\left[\mathrm{var}\left(Y_{\text{}t}\right)=\mathrm{var}\left(X_t^d\right)\right]$ , autocovariances $\left[R_y\left(k\right)=\mathrm{cov}\left(Y_t{Y}_{t-k}\right)=\mathrm{cov}\left(X_t^d{X}_{t-k}^d\right)\right]$ were obtained to be [11]

$E\left(Y_t\right)=E\left(X_t^d\right)=\{\begin{array}{l}{\sigma }^{\text{}2m}\left(2m-1\right)!!,d=2m,m=1,2,\cdots \\ 0,d=2m+1,m=0,1,2,\cdots \end{array}$ (1.10)

$Var\left(Y_t\right)=Var\left(X_t^d\right)=\{\begin{array}{l}{\sigma }^{4m}\left[{\displaystyle \underset{k=1}{\overset{2m}{\prod }}\left(2k-1\right)}-{\left({\displaystyle \underset{k=1}{\overset{m}{\prod }}\left(2k-1\right)}\right)}^2\right],d=2m\\ {\sigma }^{2\left(2m+1\right)}{\displaystyle \underset{k=1}{\overset{2m+1}{\prod }}\left(2k-1\right)},d=2m+1\end{array}$ (1.11)

$R_Y\left(k\right)=R_{X_t^d}\left(\mathcal{l}\right)=\{\begin{array}{l}{\sigma }^{4m}\left[{\displaystyle \underset{k=1}{\overset{2m}{\prod }}\left(2k-1\right)}-{\left({\displaystyle \underset{k=1}{\overset{m}{\prod }}\left(2k-1\right)}\right)}^2\right],d=2m,\mathcal{l}=0\\ {\sigma }^{2\left(2m+1\right)}{\displaystyle \underset{k=1}{\overset{2m+1}{\prod }}\left(2k-1\right)},d=2m+1,\mathcal{l}=0\\ 0,\mathcal{l}\ne 0\end{array}$ (1.12)

where

$\left(2m-1\right)!!={\displaystyle \underset{k=1}{\overset{m}{\prod }}\left(2k-1\right)}$ (1.13)

It is clear from (1.12) that when $X_{\text{}t},t\in Z$ are iid, the powers $Y_t=X_t^d,d=1,2,3,\cdots$ of $X_{\text{}t},t\in Z$ are also iid. Iwueze et al. [11] also showed the probability density function (pdf) of $Y_t=X_t^2$ to be the pdf of a gamma distribution with parameters

$\alpha =\frac{1}{2},\beta =2{\sigma }^2$ . That is, $Y_t=X_t^2~G\left(\alpha ,\beta \right),\alpha =\frac{1}{2},\beta =2{\sigma }^2$ .

when $X_{\text{}t}~N\left(0,{\sigma }^2\right)$ and [11] concluded that all powers of a linear Gaussian white noise process are iid but not normally distributed.

Using the coefficient of symmetry and kurtosis, Iwueze et al. [11] confirmed the non-normality of $Y_t=X_t^d,d=2,3,\cdots$ . Table 1 gives the mean, variance, the coefficient of symmetry ( ${\beta }_1$ ) and kurtosis ( ${\beta }_2$ ) defined as follows

${\beta }_1=\frac{{\mu }_3\left(d\right)}{{\left({\mu }_2\left(d\right)\right)}^{3/2}}$ (1.14)

${\beta }_2=\frac{{\mu }_4\left(d\right)}{{\left({\mu }_2\left(d\right)\right)}^2}$ (1.15)

where

${\mu }_2\left(d\right)=E\left[{\left(X_t^d-E\left(X_t^d\right)\right)}^2\right]=\mathrm{var}\left(X_t^d\right)$ (1.16)

Source: Iwueze et al. (2017).

${\mu }_3\left(d\right)=E\left[{\left(X_t^d-E\left(X_t^d\right)\right)}^3\right]$ (1.17)

${\mu }_4\left(d\right)=E\left[{\left(X_t^d-E\left(X_t^d\right)\right)}^4\right]$ (1.18)

Using the standard deviations when ${\sigma }^2=1$ and the kurtosis of $Y_t=X_t^d,d=1,2,3,\cdots$ , Iwueze et al. [11] determined the optimal value of d to be three ( $d=3$ ). Hence, for effective comparison of the linear Gaussian white noise process with any stochastic process with similar covariance structure, $Y_t=X_t^d,d=1,2,3$ must be used.

The most commonly used white noise process is the linear Gaussian white noise process. The process is one of the major outcomes of any estimation procedure which is used in checking the adequacy of fitted models. The linear Gaussian white noise process also plays significant role as a basic building block in the construction of linear and non-linear time series models. However, the major problem is that there are many non-linear processes that exhibit the same covariance structure (Equation (1.1) through Equation (1.5)) as the linear Gaussian white noise process. One of such non-linear models is the bilinear models.

The study of bilinear models was introduced by Granger and Andersen [12] and Subba Rao [13] . Granger and Andersen [14] established that all series generated by the simple bilinear model

$X_t=\beta X_{t-k}{e}_{t-j}+e_t,k>j$ (1.19)

appear to be second order white noise where $\beta$ is a constant and $e_{\text{}t},t\in Z$ is an independent identically distributed normal random variable with $E\left(e_{\text{}t}\right)=0$ , $E\left(e_t^2\right)={\sigma }^2<\infty$ . Guegan [15] studied the existence problem of a simple bilinear process $X_t,t\in Z$ satisfying

$X_t=\beta X_{t-2}{e}_{t-1}+e_t$ (1.20)

Martins [16] obtained the autocorrelation function of the process $X_t^2,t\in Z$ for the simple bilinear model defined by (1.19) when $e_{\text{}t},t\in Z$ is iid with a Gaussian distribution. Again, Martins [16] studied the third order moment structure of (1.19) with non-independent shocks. Recently, properties of the simple bilinear model (1.19) were addressed by Malinski and Bielinska [17] , Malinski and Figwer [18] and Malinski [19] . Iwueze [20] studied the more general bilinear white noise model

$X_t=\left({\displaystyle \underset{j=1}{\overset{m}{\sum }}{\beta }_j{X}_{t-q-j}}\right)e_{t-q}+e_t$ (1.21)

where $e_{\text{}t},t\in Z$ is as defined in (1.19). Iwueze [20] was able to show the following.

1) The series $X_{\text{}t},t\in Z$ satisfying (1.21) is strictly stationary, ergodic and unique.

2) The series $X_{\text{}t},t\in Z$ satisfying (1.21) is invertible.

3) The series $X_{\text{}t},t\in Z$ satisfying (1.21) has the same covariance structure as the linear Gaussian white noise processes.

4) Obtained the covariance structure of (1.21) to be

$\mu =E\left(X_t\right)=0$ (1.22)

$R\left(k\right)=\{\begin{array}{l}\frac{{\sigma }^2}{1-{\displaystyle \underset{j=1}{\overset{m}{\sum }}{\sigma }^2{\beta }_j^2}},k=0\\ 0,\text{otherwise}\end{array}$ (1.23)

5) The series satisfying (1.21) is invertible if

$2{\displaystyle \underset{j=1}{\overset{m}{\sum }}{\beta }_j^2{\sigma }^2}<1$ (1.24)

For the simple bilinear model (1.19), it follows that

$R\left(k\right)=\{\begin{array}{l}\frac{1}{1-{\sigma }^2{\beta }^2},{\sigma }^2{\beta }^2<1\\ 0,\text{otherwise}\end{array}$ (1.25)

and the invertibility condition is

${\sigma }^2{\beta }^2<\frac{1}{2}$ (1.26)

It is worthy to note that the stationarity condition

${\sigma }^2{\beta }^2<1$ (1.27)

is structure (k, n) independent [19] for model (1.19) and our study in this paper will concentrate on model (1.20). The purpose of this paper is to meet the following goals for the simple bilinear model satisfying (1.20).

1) Determine $Var\left(X_t^d\right),d=2,3$ for the simple bilinear model (1.20).

2) Determine the covariance structure of $X_t^d,d=2,3$ , when $X_{\text{}t},t\in Z$ satisfies (1.20).

3) Determine for what values of $\beta$ the simple bilinear white noise process will be identified as a Linear Gaussian white noise process.

4) Determine for what values of $\beta$ the simple bilinear model will be normally distributed.

This paper is further divided into four sections in order to establish and achieve these goals. Section 2 discusses the covariance structure of $Y_t=X_t^d,d=1,2,3$ when $X_t=\beta X_{t-2}{e}_{t-1}+e_t$ , $e_t~iidN\left(0,{\sigma }^2\right)$ , Section 3 presents the methodology, Section 4 is the results and discussion while, Section five is the conclusion.

2. Covariance Structure of $Y_t=X_t^d,d=1,2,3$ , When $X_t=\beta X_{t-2}{e}_{t-1}+e_t$ , $e_t~iidN\left(0,{\sigma }^2\right)$

Theorem 2.1.

Let $e_t,t\in Z$ be the linear Gaussian white noise process with $E\left(e_{\text{}t}\right)=0$ and $E\left(e_t^2\right)={\sigma }^2<\infty$ . Suppose there exists a stationary and invertible process $X_{\text{}t},t\in Z$ satisfying $X_t=\beta X_{t-2}{e}_{t-1}+e_t$ for every $t\in Z$ for some constant $\beta$ , then $Y_t=X_t^2$ has the following properties:

$E\left(Y_t\right)={\mu }_Y=\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2};{\sigma }^2{\beta }^2<1$ (2.1)

$R_Y\left(k\right)=\mathrm{cov}\left(Y_t,Y_{t-k}\right)=\{\begin{array}{l}\frac{2{\sigma }^4}{{\left(1-{\sigma }^2{\beta }^2\right)}^2\left(1-3{\sigma }^4{\beta }^4\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt{3}},k=0\\ \frac{2{\sigma }^6{\beta }^2}{{\left(1-{\sigma }^2{\beta }^2\right)}^2},{\sigma }^2{\beta }^2<1,k=1\\ {\sigma }^2{\beta }^2{R}_Y\left(k-2\right),k=2,3,\cdots \end{array}$ (2.2)

${\rho }_Y\left(k\right)=\frac{R_Y\left(k\right)}{R_Y\left(0\right)}=\{\begin{array}{l}1,k=0\\ {\sigma }^2{\beta }^2\left(1-3{\sigma }^4{\beta }^4\right),k=1\\ {\sigma }^2{\beta }^2{\rho }_Y\left(k-2\right),k=2,3,\cdots \end{array}$ (2.3)

$Y_t=X_t^2,t\in Z$ has the same covariance structure as the linear ARMA(2, 1) process (2.4)

$X_t=\lambda +{\varphi }_1{X}_{t-1}+{\varphi }_2{X}_{t-2}+{\theta }_1{a}_{t-1}+a_t,{\varphi }_1=0$ (2.4)

where $a_t$ is the sequence of independent and identically distributed random variable with $E\left(a_t\right)=0$ and $Var\left(a_t\right)={\sigma }_1^2<\infty$ .

Proof:

Let

$Y_t=X_t^2={\left(\beta X_{t-2}{e}_{t-1}+e_t\right)}^2={\beta }^2{X}_{t-2}^2{e}_{t-1}^2+e_t^2+2\beta X_{t-2}{e}_{t-1}{e}_t$

$E\left(Y_t\right)=E\left(X_t^2\right)={\beta }^{2}E\left(X_{t-2}^2\right)E\left(e_{t-1}^2\right)+E\left(e_t^2\right)+2\beta E\left(X_{t-2}\right)E\left(e_{t-1}\right)E(t)$

$E\left(Y_t\right)=E\left(X_t^2\right)={\beta }^{2}E\left(X_t^2\right)E\left(e_t^2\right)+E\left(e_t^2\right)={\sigma }^2{\beta }^{2}E\left(X_t^2\right)+{\sigma }^2$

$\left(1-{\sigma }^2{\beta }^2\right)E\left(X_t^2\right)={\sigma }^2$

${\mu }_Y=E\left(X_t^2\right)=\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2};{\sigma }^2{\beta }^2<1$ (2.5)

$Var\left(Y_t\right)=Var\left(X_t^2\right)=E\left(X_t^4\right)-{\left[E\left(X_t^2\right)\right]}^2$

$X_t^4={\beta }^4{X}_{t-2}^4{e}_{t-1}^4+4{\beta }^3{X}_{t-2}^3{e}_{t-1}^3{e}_t+6{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t^2+4\beta X_{t-2}{e}_{t-1}{e}_t^3+e_t^4$

$E\left(X_t^4\right)=3{\sigma }^4{\beta }^{4}E\left(X_t^4\right)+6{\sigma }^4{\beta }^{2}E\left(X_t^2\right)+3{\sigma }^4$

$\left(1-3{\sigma }^4{\beta }^4\right)E\left(X_t^4\right)=\frac{6{\sigma }^6{\beta }^2}{1-{\sigma }^2{\beta }^2}+3{\sigma }^4$

$\Rightarrow E\left(X_t^4\right)=\frac{3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)},{\sigma }^4{\beta }^4<\frac{1}{\sqrt{3}}$ (2.6)

Now,

$\begin{array}{c}Var\left(Y_t\right)=Var\left(X_t^2\right)=E\left(X_t^4\right)-{\left[E\left(X_t^2\right)\right]}^2\\ =\frac{3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}-{\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)}^2\\ =\frac{3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)\left(1-{\sigma }^2{\beta }^2\right)-{\sigma }^4\left(1-3{\sigma }^4{\beta }^4\right)}{{\left(1-{\sigma }^2{\beta }^2\right)}^2\left(1-3{\sigma }^4{\beta }^4\right)}\end{array}$ (2.7)

Hence,

$R_Y\left(0\right)=Var\left(Y_t\right)=Var\left(X_t^2\right)=\frac{2{\sigma }^4}{{\left(1-{\sigma }^2{\beta }^2\right)}^2\left(1-3{\sigma }^4{\beta }^4\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt{3}}$ (2.8)

$R_Y\left(k\right)=E\left[Y_t{Y}_{t-\mathcal{l}}\right]-{\mu }_y^2=E\left[X_t^2{X}_{t-\mathcal{l}}^2\right]-{\mu }_x^2,k=0,1,2,\cdots$

$Y_t{Y}_{t-1}=X_t^2{X}_{t-1}^2={\beta }^2{X}_{t-2}^2{X}_{t-1}^2{e}_{t-1}^2+2\beta X_{t-2}{X}_{t-1}^2{e}_{t-1}{e}_t+X_{t-1}^2{e}_t^2$

$E\left[Y_t{Y}_{t-1}\right]={\beta }^{2}E\left[X_{t-2}^2{X}_{t-1}^2{e}_{t-1}^2\right]+{\sigma }^{2}E\left(X_{t-1}^2\right)$

$E\left[Y_t{Y}_{t-1}\right]={\beta }^{2}E\left[X_{t-1}^2{X}_t^2{e}_t^2\right]+{\sigma }^{2}E\left(X_t^2\right)$

$X_{t-1}^2{X}_t^2{e}_t^2=X_{t-1}^2\left({\beta }^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-2}{e}_{t-1}{e}_t+e_t\right)e_t^2$

$X_{t-1}^2{X}_t^2{e}_t^2={\beta }^2{X}_{t-2}^2{X}_{t-1}^2{e}_{t-1}^2{e}_t^2+2\beta X_{t-2}{X}_{t-1}^2{e}_{t-1}{e}_t^3+X_{t-1}^2{e}_t^4$

By the assumption of stationarity,

$E\left[X_{t-1}^2{X}_t^2{e}_t^2\right]={\sigma }^2{\beta }^{2}E\left[X_{t-1}^2{X}_t^2{e}_t^2\right]+3{\sigma }^{4}E\left(X_t^2\right)$

$\left(1-{\sigma }^2{\beta }^2\right)E\left[X_{t-1}^2{X}_t^2{e}_t^2\right]=3{\sigma }^4\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)$

$E\left[X_{t-1}^2{X}_t^2{e}_t^2\right]=\frac{3{\sigma }^6}{{\left(1-{\sigma }^2{\beta }^2\right)}^2},{\sigma }^2{\beta }^2<1$ (2.9)

$E\left[Y_t{Y}_{t-1}\right]={\beta }^2\left[\frac{3{\sigma }^6}{{\left(1-{\sigma }^2{\beta }^2\right)}^2}\right]+{\sigma }^2\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)=\frac{{\sigma }^4\left(1+2{\sigma }^2{\beta }^2\right)}{{\left(1-{\sigma }^2{\beta }^2\right)}^2}$ (2.10)

Hence,

$R_y\left(1\right)=E\left(Y_t{Y}_{t-1}\right)=E^2\left(Y_t\right)=\frac{{\sigma }^4\left(1+2{\sigma }^2{\beta }^2\right)}{{\left(1-{\sigma }^2{\beta }^2\right)}^2}-{\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)}^2=\frac{2{\sigma }^6{\beta }^2}{{\left(1-{\sigma }^2{\beta }^2\right)}^2}$ (2.11)

$Y_t{Y}_{t-2}=X_t^2{X}_{t-2}^2=\left({\beta }^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-2}{e}_{t-1}{e}_t+e_t^2\right)X_{t-2}^2$

$Y_t{Y}_{t-2}={\beta }^2{X}_{t-2}^4{e}_{t-1}^2+2\beta X_{t-2}^3{e}_{t-1}{e}_t+X_{t-2}^2{e}_t^2$

$E\left[Y_t{Y}_{t-2}\right]={\sigma }^2{\beta }^{2}E\left(X_{t-2}^4\right)+{\sigma }^{2}E\left(X_{t-2}^2\right)$

$E\left[Y_t{Y}_{t-2}\right]={\sigma }^2{\beta }^{2}E\left(Y_{t-2}^2\right)+{\sigma }^{2}E(Yt)$

$\Rightarrow E\left[Y_t{Y}_{t-2}\right]={\sigma }^2{\beta }^{2}E\left(Y_t^2\right)+{\sigma }^2{\mu }_y$

$R_y\left(2\right)+{\mu }_y^2={\sigma }^2{\beta }^2\left[R_y\left(0\right)+{\mu }_y^2\right]+{\sigma }^2{\mu }_y$ (2.12)

$\begin{array}{c}{R}_y\left(2\right)={\sigma }^2{\beta }^2{R}_y\left(0\right)+{\sigma }^2{\beta }^2{\mu }_y^2+{\sigma }^2{\mu }_y-{\mu }_y^2\\ ={\sigma }^2{\beta }^2{R}_y\left(0\right)+{\sigma }^2{\mu }_y-{\mu }_y^2\left(1-{\sigma }^2{\beta }^2\right)\end{array}$

Note that

${\mu }_Y=E\left(Y_t\right)=E\left(X_t^2\right)=\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}$

$\Rightarrow \left(1-{\sigma }^2{\beta }^2\right){\mu }_Y={\sigma }^2$

$1-{\sigma }^2{\beta }^2=\frac{{\sigma }^2}{{\mu }_Y}$ (2.13)

Hence

$\begin{array}{c}{R}_Y\left(2\right)={\sigma }^2{\beta }^2{R}_y\left(0\right)+{\sigma }^2{\mu }_y-{\mu }_y^2\left(\frac{{\sigma }^2}{{\mu }_y}\right)\\ ={\sigma }^2{\beta }^2{R}_y\left(0\right)+{\sigma }^2{\mu }_y-{\sigma }^2{\mu }_y={\sigma }^2{\beta }^2{R}_y\left(0\right)\end{array}$ (2.14)

We have shown that

${\sigma }^2{\beta }^2{\mu }_y^2+{\sigma }^2{\mu }_y-{\mu }_y^2=0$ (2.15)

Similarly;

$Y_t{Y}_{t-3}=X_t^2{X}_{t-3}^2=\left({\beta }^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-2}{e}_{t-1}{e}_t+e_t^2\right)X_{t-3}^2$

$Y_t{Y}_{t-3}={\beta }^2{X}_{t-3}^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-3}^2{X}_{t-2}{e}_{t-1}{e}_t+X_{t-3}^2{e}_t^2$

$E\left[Y_t{Y}_{t-3}\right]={\sigma }^2{\beta }^{2}E\left[X_{t-2}^2{X}_{t-1}^2\right]+{\sigma }^{2}E\left(X_t^2\right)={\sigma }^2{\beta }^{2}E\left[Y_t{Y}_{t-1}\right]+{\sigma }^{2}E(Yt)$

$\begin{array}{l}\Rightarrow R_y\left(3\right)+{\mu }_y^2={\sigma }^2{\beta }^2\left[R_y\left(1\right)+{\mu }_y^2\right]+{\mu }_y^2\\ ={\sigma }^2{\beta }^2{R}_y\left(1\right)+{\sigma }^2{\beta }^2{\mu }_y^2+{\sigma }^2{\mu }_y-{\mu }_y^2\\ ={\sigma }^2{\beta }^2{R}_y\left(1\right)\end{array}$ (2.16)

Generally;

$R_Y\left(k\right)={\sigma }^2{\beta }^2{R}_Y\left(k-2\right),k=2,3,\cdots$ (2.17)

Hence,

$R_Y\left(k\right)=\{\begin{array}{l}\frac{2{\sigma }^4}{{\left(1-{\sigma }^2{\beta }^2\right)}^2\left(1-3{\sigma }^4{\beta }^4\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt{3}},k=0\\ \frac{2{\sigma }^6{\beta }^2}{{\left(1-{\sigma }^2{\beta }^2\right)}^2},{\sigma }^2{\beta }^2<1,k=1\\ {\sigma }^2{\beta }^2{R}_Y\left(k-2\right),k=2,3,\cdots \end{array}$ (2.18)

and

${\rho }_Y\left(k\right)=\{\begin{array}{l}1,k=0\\ {\sigma }^2{\beta }^2\left(1-3{\sigma }^4{\beta }^4\right),k=1\\ {\sigma }^2{\beta }^2{\rho }_Y\left(k-2\right),k=2,3,\cdots \end{array}$ (2.19)

With this result, it is clear that when $X_t,t\in Z$ is defined by (1.20), $Y_t=X_t^2$ has the same covariance structure as the linear ARMA(2, 1) process. Its linear equivalence is

$Y_t=\lambda +{\varphi }_1{X}_{t-1}+{\varphi }_2{Y}_{t-2}+{\theta }_1{a}_{t-1}+a_t,{\varphi }_1=0$ (2.20)

where $a_t$ is the purely random process with $E\left(a_t\right)=0$ and $Var\left(a_t\right)={\sigma }_1^2<\infty$ . Table 2 compares $Y_t=X_t^2$ with its linear ARMA(2, 1) equivalence.

Theorem 2.2.:

Let $e_t,t\in Z$ be the linear Gaussian white noise process with $E\left(e_t\right)=0$ and $E\left(e_t^2\right)={\sigma }^2<\infty$ . Suppose there exists a stationary and invertible process $X_t,t\in Z$ satisfying $X_t=\beta X_{t-2}{e}_{t-1}+e_t$ for every $t\in Z$ and some constant $\beta$ , then the mean and variance of $Y_t=X_t^3,t\in Z$ are

$E\left(Y_t\right)={\mu }_Y=0$ (2.21)

$R_Y\left(k\right)=\{\begin{array}{l}\frac{15{\sigma }^6\left(1+2{\sigma }^2{\beta }^2+6{\sigma }^4{\beta }^4+3{\sigma }^6{\beta }^6\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)\left(1-15{\sigma }^6{\beta }^6\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt[3]{15}},k=0\\ 0,k\ne 0\end{array}$ (2.22)

${\rho }_k\left(k\right)=\{\begin{array}{l}1,k=0\\ 0,k\ne 0\end{array}$ (2.23)

The covariance structure of $Y_t=X_t^3,t\in Z$ is that of the linear white noise process.

Proof:

Let $Y_t=X_t^3={\left(\beta X_{t-2}{e}_{t-1}+e_t\right)}^3={\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3$ (2.24)

$\begin{array}{c}E\left(Y_t\right)=E\left(X_t^3\right)={\mu }_y={\beta }^{3}E\left(X_{t-2}^3{e}_{t-1}^3\right)+3{\sigma }^2{\beta }^{2}E\left(X_{t-2}{e}_{t-1}\right)\\ ={\beta }^{3}E\left(X_{t-1}^3{e}_t^3\right)+3{\sigma }^2{\beta }^{2}E\left(X_{t-1}{e}_t\right)=0\end{array}$ (2.25)

$\begin{array}{c}{Y}_t^2=X_t^6={\left(\beta X_{t-2}{e}_{t-1}+e_t\right)}^6\\ ={\beta }^6{X}_{t-2}^6{e}_{t-1}^6+6{\beta }^5{X}_{t-2}^5{e}_{t-1}^5{e}_t+15{\beta }^4{X}_{t-2}^4{e}_{t-1}^4{e}_t^2+20{\beta }^3{X}_{t-2}^3{e}_{t-1}^3{e}_t^3\\ +15{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t^4+6\beta X_{t-2}{e}_{t-1}{e}_t^5+e_t^6\end{array}$ (2.26)

$\begin{array}{c}E\left(Y_t^2\right)={\beta }^{6}E\left(X_{t-2}^6{e}_{t-1}^6\right)+6{\beta }^{5}E\left(X_{t-2}^5{e}_{t-1}^5{e}_t\right)+15{\beta }^{4}E\left(X_{t-2}^4{e}_{t-1}^4{e}_t^2\right)\\ +20{\beta }^{3}E\left(X_{t-2}^3{e}_{t-1}^3{e}_t^3\right)+15{\beta }^{2}E\left(X_{t-2}^2{e}_{t-1}^2{e}_t^4\right)+6\beta E\left(X_{t-2}{e}_{t-1}{e}_t^5\right)+E\left(e_t^6\right)\\ ={\beta }^{6}E\left(X_{t-2}^6{e}_{t-1}^6\right)+15{\sigma }^2{\beta }^{4}E\left(X_{t-2}^4{e}_{t-1}^4\right)+45{\sigma }^4{\beta }^{2}E\left(X_{t-2}^2{e}_{t-1}^2\right)+15{\sigma }^6\\ =15{\sigma }^6{\beta }^{6}E\left(X_t^6\right)+45{\sigma }^6{\beta }^{4}E\left(X_t^4\right)+45{\sigma }^6{\beta }^{2}E\left(X_t^2\right)+15{\sigma }^6\\ =15{\sigma }^6{\beta }^{6}E\left(Y_t^2\right)+45{\sigma }^6{\beta }^4\left[\frac{3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}\right]\\ +45{\sigma }^6{\beta }^2\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)+15{\sigma }^6\end{array}$

$\begin{array}{l}\left(1-15{\sigma }^6{\beta }^6\right)E\left(Y_t^2\right)\\ =45{\sigma }^6{\beta }^4\left[\frac{3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}\right]+45{\sigma }^6{\beta }^2\left(\frac{{\sigma }^2}{1-{\sigma }^2{\beta }^2}\right)+15{\sigma }^6\\ =\frac{1}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}[45{\sigma }^6{\beta }^4\left[3{\sigma }^4\left(1+{\sigma }^2{\beta }^2\right)\right]\\ +45{\sigma }^6{\beta }^2\left[{\sigma }^2\left(1-3{\sigma }^4{\beta }^4\right)\right]+15{\sigma }^6\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)]\end{array}$

$\begin{array}{l}=\frac{1}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}[135{\sigma }^{10}{\beta }^4+135{\sigma }^{12}{\beta }^6+45{\sigma }^8{\beta }^2\\ -135{\sigma }^{12}{\beta }^6+15{\sigma }^6-45{\sigma }^{10}{\beta }^4-15{\sigma }^8{\beta }^2+45{\sigma }^{12}{\beta }^6]\\ =\frac{1}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)}\left[90{\sigma }^{10}{\beta }^4+30{\sigma }^8{\beta }^2+15{\sigma }^6+45{\sigma }^{12}{\beta }^6\right]\\ =\frac{15{\sigma }^6\left(1+2{\sigma }^2{\beta }^2+6{\sigma }^4{\beta }^4+3{\sigma }^6{\beta }^6\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt[3]{15}}\end{array}$ (2.27)

$\therefore E\left(Y_t^2\right)=R_y\left(0\right)+{\mu }_y^2$ (2.28)

$\begin{array}{l}\Rightarrow Var\left(Y_t\right)=Var\left(X_t^3\right)=R_y\left(0\right)=E\left(Y_t^2\right)-{\mu }_y^2\\ =\frac{15{\sigma }^6\left(1+2{\sigma }^2{\beta }^2+6{\sigma }^4{\beta }^4+3{\sigma }^6{\beta }^6\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)\left(1-15{\sigma }^6{\beta }^6\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt[3]{15}}\end{array}$ (2.29)

Some Results

$E\left(X_{t-1}{X}_t{e}_t\right)={\sigma }^{2}E\left(X_t\right)=0$

Proof:

$X_{t-1}{X}_t{e}_t=X_{t-1}\left[\beta X_{t-2}{e}_{t-1}+e_t\right]e_t=\beta X_{t-2}{X}_{t-1}{e}_{t-1}{e}_t+X_{t-1}{e}_t^2$

$E\left(X_{t-1}{X}_t{e}_t\right)={\sigma }^{2}E\left(X_{t-1}\right)={\sigma }^{2}E\left(X_t\right)=0$

$E\left(X_{t-1}{X}_t^2{e}_t\right)=2{\sigma }^2\beta E\left(X_{t-1}{X}_t{e}_t\right)=0$

Proof:

$\begin{array}{c}{X}_{t-1}{X}_t^2{e}_t=X_{t-1}\left[{\beta }^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-2}{e}_{t-1}{e}_t+e_t^2\right]e_t\\ ={\beta }^2{X}_{t-2}^2{X}_{t-1}{e}_{t-1}^2{e}_t+2\beta X_{t-2}{X}_{t-1}{e}_{t-1}{e}_t^2+e_t^3\end{array}$

$E\left(X_{t-1}{X}_t^2{e}_t\right)=2\beta {\sigma }^{2}E\left(X_{t-2}{X}_{t-1}{e}_{t-1}\right)=2\beta {\sigma }^{2}E\left(X_{t-1}{X}_t{e}_t\right)=0$

$E\left(X_{t-1}^2{X}_t{e}_t^2\right)={\sigma }^2\beta E\left(X_{t-1}{X}_t^2{e}_t\right)=0$

Proof:

$X_{t-1}^2{X}_t{e}_t^2=X_{t-1}^2\left[\beta X_{t-2}{e}_{t-1}+e_t\right]e_t^2=\beta X_{t-2}{X}_{t-1}^2{e}_{t-1}+X_{t-1}^2{e}_t^3$

$E\left(X_{t-1}^2{X}_t{e}_t^2\right)={\sigma }^2\beta E\left(X_{t-2}{X}_{t-1}^2{e}_{t-1}\right)={\sigma }^2\beta E\left(X_{t-1}{X}_t^2{e}_t\right)=0$

$E\left(X_{t-1}{X}_t^3{e}_t\right)=3{\sigma }^2{\beta }^{2}E\left(X_{t-1}^2{X}_t{e}_t^2\right)=0$

Proof:

$\begin{array}{c}{X}_{t-1}{X}_t^3{e}_t=X_{t-1}\left[{\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3\right]e_t\\ ={\beta }^3{X}_{t-2}^3{X}_{t-1}{e}_{t-1}^3{e}_t+3{\beta }^2{X}_{t-2}^2{X}_{t-1}{e}_{t-1}^2{e}_t^2+3\beta X_{t-2}{X}_{t-1}{e}_{t-1}{e}_t^3+X_{t-1}{e}_t^4\end{array}$

$E\left(X_{t-1}{X}_t^3{e}_t\right)=3{\sigma }^2{\beta }^{2}E\left(X_{t-2}^2{X}_{t-1}{e}_{t-1}^2\right)=3{\sigma }^2{\beta }^{2}E\left(X_{t-1}^2{X}_t{e}_t^2\right)=0$

ÞNow

$\begin{array}{c}{Y}_t{Y}_{t-1}=X_t^3{X}_{t-1}^3=\left[{\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3\right]X_{t-1}^3\\ ={\beta }^3{X}_{t-2}^3{X}_{t-1}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{X}_{t-1}^3{e}_{t-1}^2{e}_t+3\beta X_{t-2}{X}_{t-1}^3{e}_{t-1}{e}_t^2+X_{t-1}^3{e}_t^3\end{array}$

$\begin{array}{c}E\left(Y_t{Y}_{t-1}\right)={\beta }^{3}E\left(X_{t-2}^3{X}_{t-1}^3{e}_{t-1}^3\right)+3{\sigma }^2\beta E\left(X_{t-2}{X}_{t-1}^3{e}_{t-1}\right)\\ ={\beta }^{3}E\left(X_{t-1}^3{X}_t^3{e}_t^3\right)+3{\sigma }^2\beta E\left(X_{t-1}{X}_t^3{e}_t\right)\\ ={\beta }^{3}E\left(X_{t-1}^3{X}_t^3{e}_t^3\right)\end{array}$

$\begin{array}{c}{X}_{t-1}^3{X}_t^3{e}_t^3=X_{t-1}^3\left[{\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3\right]e_t^3\\ ={\beta }^3{X}_{t-2}^3{X}_{t-1}^3{e}_{t-1}^3{e}_t^3+3{\beta }^2{X}_{t-2}^2{X}_{t-1}^3{e}_{t-1}^2{e}_t^4+3\beta X_{t-2}{X}_{t-1}^3{e}_{t-1}{e}_t^5+X_{t-1}^3{e}_t^6\end{array}$

$\begin{array}{c}E\left(X_{t-1}^3{X}_t^3{e}_t^3\right)=3{\beta }^2\left(3{\sigma }^4\right)E\left(X_{t-2}^2{X}_{t-1}^3{e}_{t-1}^2\right)\\ =9{\sigma }^4{\beta }^{2}E\left(X_{t-2}^2{X}_{t-1}^3{e}_{t-1}^2\right)\\ =9{\sigma }^4{\beta }^{2}E\left(X_{t-1}^2{X}_t^3{e}_t^2\right)\end{array}$

Hence,

$E\left(Y_t{Y}_{t-1}\right)={\beta }^3\left[9{\sigma }^4{\beta }^{2}E\left(X_{t-1}^2{X}_t^3{e}_t^2\right)\right]=9{\sigma }^4{\beta }^{5}E\left(X_{t-1}^2{X}_t^3{e}_t^2\right)$

Now

$\begin{array}{c}{X}_{t-1}^2{X}_t^3{e}_t^2=X_{t-1}^2\left[{\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3\right]e_t^2\\ ={\beta }^3{X}_{t-2}^3{X}_{t-1}^2{e}_{t-1}^3{e}_t^2+3{\beta }^2{X}_{t-2}^2{X}_{t-1}^2{e}_{t-1}^2{e}_t^3+3\beta X_{t-2}{X}_{t-1}^2{e}_{t-1}{e}_t^4+X_{t-1}^2{e}_t^5\end{array}$

$\begin{array}{c}E\left(X_{t-1}^2{X}_t^3{e}_t^2\right)={\sigma }^2{\beta }^{3}E\left(X_{t-2}^3{X}_{t-1}^2{e}_{t-1}^3\right)+3\beta \left(3{\sigma }^4\right)E\left(X_{t-2}{X}_{t-1}^2{e}_{t-1}\right)\\ ={\sigma }^2{\beta }^{3}E\left(X_{t-1}^3{X}_t^2{e}_t^3\right)+9{\sigma }^4\beta E\left(X_{t-1}{X}_t^2{e}_t\right)\\ ={\sigma }^2{\beta }^{3}E\left(X_{t-1}^3{X}_t^2{e}_t^3\right)\end{array}$

But,

$\begin{array}{c}E\left(Y_t{Y}_{t-1}\right)=9{\sigma }^4{\beta }^{5}E\left(X_{t-1}^2{X}_t^3{e}_t^2\right)=9{\sigma }^4{\beta }^5\left({\sigma }^2{\beta }^{3}E\left(X_{t-1}^3{X}_t^2{e}_t^3\right)\right)\\ =9{\sigma }^6{\beta }^{8}E\left(X_{t-1}^3{X}_t^2{e}_t^3\right)\end{array}$

Now,

$\begin{array}{c}{X}_{t-1}^3{X}_t^2{e}_t^3=X_{t-1}^3\left[{\beta }^2{X}_{t-2}^2{e}_{t-1}^2+2\beta X_{t-2}{e}_{t-1}{e}_t+e_t^2\right]e_t^3\\ ={\beta }^2{X}_{t-2}^2{X}_{t-1}^3{e}_{t-1}^2{e}_t^3+2\beta X_{t-2}{X}_{t-1}^3{e}_{t-1}{e}_t^4+X_{t-1}^3{e}_t^5\end{array}$

$E\left(X_{t-1}^3{X}_t^2{e}_t^3\right)=2\beta \left(3{\sigma }^4\right)E\left(X_{t-2}{X}_{t-1}^3{e}_{t-1}\right)=6{\sigma }^4\beta E\left(X_{t-1}{X}_t^3{e}_t\right)=0$

Hence,

$E\left(Y_t{Y}_{t-1}\right)=9{\sigma }^6{\beta }^8\left[6{\sigma }^4\beta E\left(X_{t-1}{X}_t^3{e}_t\right)\right]=54{\sigma }^{10}{\beta }^{9}E\left(X_{t-1}{X}_t^3{e}_t\right)=0$

$\Rightarrow R_Y\left(1\right)=0$ , when $Y=X_t^3$ .

$\begin{array}{c}{Y}_t{Y}_{t-2}=X_t^3{X}_{t-2}^3=\left[{\beta }^3{X}_{t-2}^3{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^2{e}_{t-1}^2{e}_t+3\beta X_{t-2}{e}_{t-1}{e}_t^2+e_t^3\right]X_{t-2}^3\\ ={\beta }^3{X}_{t-2}^6{e}_{t-1}^3+3{\beta }^2{X}_{t-2}^5{e}_{t-1}^2{e}_t+3\beta X_{t-2}^4{e}_{t-1}{e}_t^2+X_{t-2}^3{e}_t^3\end{array}$

$E\left(Y_t{Y}_{t-2}\right)=0$

$\Rightarrow R_Y\left(2\right)=0$ , when $Y=X_t^3$ .

Generally, $R_Y\left(k\right)=0\forall k\ne 0$ , when $Y=X_t^3$ .

Therefore, given $X_t=\beta X_{t-2}{e}_{t-1}+e_t$ , $e_t~N\left(0,{\sigma }^2\right)$ and $Y_t=X_t^3$ , the following are true $E\left(Y_t\right)=E\left(X_t^3\right)=0$ .

$R_Y\left(k\right)=\{\begin{array}{l}\frac{15{\sigma }^6\left(1+2{\sigma }^2{\beta }^2+6{\sigma }^4{\beta }^4+3{\sigma }^6{\beta }^6\right)}{\left(1-{\sigma }^2{\beta }^2\right)\left(1-3{\sigma }^4{\beta }^4\right)\left(1-15{\sigma }^6{\beta }^6\right)},{\sigma }^2{\beta }^2<\frac{1}{\sqrt[3]{15}},k=0\\ 0,k\ne 0\end{array}$

${\rho }_k\left(k\right)=\{\begin{array}{l}1,k=0\\ 0,k\ne 0\end{array}$

The covariance structure of $Y_t=X_t^3,t\in Z$ identifies the process as linear white noise.

3. Methodology

3.1. Normality Checking

The Jarque-Bera (JB) test [21] [22] [23] will be used to determine for which values of $\beta$ a simple bilinear model (1.20) is normally distributed or not. The JB test statistic is

$\text{JB}=n\left(\frac{{\hat{\gamma }}_1^2}{6}+\frac{{\left({\hat{\gamma }}_2-3\right)}^2}{24}\right)$ (3.1)

where

${\hat{\gamma }}_1=\frac{\frac{1}{n}{\displaystyle \underset{t=1}{\overset{n}{\sum }}{\left(X_t-\bar{X}\right)}^3}}{{\left(\frac{1}{n}{\displaystyle \underset{t=1}{\overset{n}{\sum }}{\left(X_t-\bar{X}\right)}^2}\right)}^{3/2}}$ (3.2)

${\hat{\gamma }}_2=\frac{\frac{1}{n}{\displaystyle \underset{t=1}{\overset{n}{\sum }}{\left(X_t-\bar{X}\right)}^4}}{{\left(\frac{1}{n}{\displaystyle \underset{t=1}{\overset{n}{\sum }}{\left(X_t-\bar{X}\right)}^2}\right)}^2}$ (3.3)

n is the sample size while, ${\hat{\gamma }}_1$ and ${\hat{\gamma }}_2$ are the sample skewness and kurtosis coefficients. The asymptotic null distribution of JB is ${\chi }^2$ with 2 degrees of freedom.

3.2. White Noise Test

The modified Ljung-Box test statistic [11] given by

$Q^{*}\left(m\right)=n\left(n+2\right){\displaystyle \underset{k=1}{\overset{m}{\sum }}\left(\frac{{\left[{\hat{\rho }}_{\text{}{X}^{\text{}d}{}^{\text{}}}\left(k\right)\right]}^{\text{}2}}{n-k}\right)}$ (3.4)

is used to test the iid hypothesis for $X_t^d,d=1,2,3$ for the simple bilinear model (1.20). It is important to note from Theorem 2.1 that $X_t^2$ has ARMA(2, 1) structure while from Theorem 2.2, $X_t^3$ is iid. This test will look for $\beta$ values where both $X_t^2$ and $X_t^3$ are jointly iid. That will help determine the values of $\beta$ for which the simple bilinear model (1.20) is not distinguishable from the linear Gaussian white noise process (LGWNP). Then, the hypothesis of iid data is rejected at level $\alpha$ if the observed $Q^{*}\left(m\right)$ is larger than the $1-\frac{\alpha }{2}$ quartile of the ${\chi }^{\text{}2}\left(m\right)$ distribution, where $m\approx \ln \left(n\right)$ [9] .

3.3. Use of Chi-Square Test for Comparison of the Simple Bilinear White Noise Process and the Linear Gaussian White Noise Process

From Theorem 2.3, the third power of the simple bilinear process is iid. A test is needed to confirm that the simple bilinear process (1.20) is not a linear Gaussian white noise process (LGWNP). For the LGWNP $X_t,t\in T$ ; $E\left(X_t\right)=\mu$ , $\mathrm{var}\left(X_t\right)={\sigma }^2<\infty$ and $\mathrm{var}\left(X_t^3\right)=15{\sigma }^6$ . To show that the simple bilinear process (1.20) is not LGWNP, we need to test the hypothesis;

$H_0:{\sigma }_{X_t^3}^2=15{\sigma }_{X_t}^6$ (3.5)

against the alternative hypothesis

$H_0:{\sigma }_{X_t^3}^2\ne 15{\sigma }_{X_t}^6$ (3.6)

The chi-square test [24] [25] can be used to perform the test. The chi-square test statistic is

${\chi }_{cal}^2=\frac{\left(n-1\right)S_{X_t^3}^2}{15{\stackrel{⌢}{\sigma }}_{X_t}^6}$ (3.7)

where $S_{X_t^3}^2$ is the sample variance of $X_t^3;X_t,t\in Z$ that follows (1.20), ${\stackrel{⌢}{\sigma }}_{X_t}^2$ is an estimate of the true variance of the simple bilinear process (1.20) and n is the number of observations of the series. The null hypothesis is rejected at level $\alpha$ if the observed value of ${\chi }_{cal}^2$ is larger than $1-\frac{\alpha }{2}$ quartile of the chi-square distribution with $n-1$ .degree of freedom. It should be noted that this test works well when the underlying original population $X_t,t\in Z$ is normally distributed.

4. Results and Discussion

One thousand random digits $e_t,t\in Z$ that met the condition $e_t~N\left(0,1\right)$ were simulated using Minitab 16 series software. Only one random digit, shown in Appendix I, was used for demonstration in the study because of want of space. The estimates of the descriptive statistics (mean, variance, skewness ( ${\gamma }_1$ ) and kurtosis ( ${\gamma }_2$ )) and other tests (Jarque Bera (JB) test, modified Ljung Box test (Q*) and chi-square calculated test statistic) for the powers $e_t^d,d=1,2,3$ of the random digit are shown in Table 3. The results obtained using the JB, Q* and the chi-square test indicated $e_t,t\in Z$ as a LGWNP at 5% level of significance.

The LGWNP were used to simulate the SBWNP $X_t=B{X}_{t-2}{e}_{t-1}+e_t$ , $e_t~N\left(0,1\right)$ for $-0.60\le \beta \le 0.60$ satisfying the existence of $E\left(X_t^3\right)$ using Fortran 77 program. The estimates of the descriptive statistic and that for the test statistic (JB, Q* and the chi-square calculated test statistic) are shown in Table 4. The values of the JB statistic show that the SBWNP are normally distributed for $-0.56\le \beta \le 0.60$ . Similarly, the values of Q* and the chi-square calculated test statistic ( $H_0$ ) show that the SBWNP is iid and can be identified as a LGWNP for some $\beta$ values. The values of $\beta$ where the SBWNP will be identified as an LGWNP are summarized in Table 5.

5. Conclusion

We have been able to establish the covariance structure for $X_t^d,d=1,2,3;t\in Z$

satisfying (1.20). We have also determined the values of $\beta$ for which the simple bilinear model (1.20) is normally distributed and in which the process can be determined as a LGWNP or not. We recommend that for proper comparison of SBWNP with LGWNP, the SBWNP should be considered for normality, white noise test and test of equality of variance of its third moment being equivalent to the theoretical values of the LGWNP.

Appendix I

Simulated Random Digits; $e_t,e_t~N\left(0,1\right)$ (Read Across).