This is a continuation of the previous post that can be found here. We discuss the Generalised CLT in this post. We give a sloppy proof of the theorem. Then we end with a series representation theorem for the Stable distributions.

**The Generalised Central Limit Theorem**

**Theorem 9:** are iid symmetric random variables with as for some and . Then

where with appropiate constants.`

**Motivation for proof:** Recall the proof of usual CLT. We assume are iid random variables mean and variance and characteristic function . We use the fact that under finite variance assumption we have

and hence using this we get

We will this idea in our proof. We will leave some of the technical details of the proof. The proof presented here is not rigourous. We primarily focus on the methodology and tricks used in the proof.

**Proof:** Let be the cdf of . is symmetric and as . Let be the characteristic function of . is real and even. We are interested in the behaviour of near . Note that

First get a large enough such that the tail behaviour is nice enough after . Then separate the integral into two parts

Now since we are interest in the integral for small enough , observe that for small enough , we have for

Thus for small enough positive we get

For the second integral, note that since is large enough

Therefore

Hence for

Since , first term vanishes as and the second term gives us in the limit

Note that as , the above integral converges near . Near , , and hence the integral is asymptotically like the integral of near . Since , we have and hence the integral converges near . Thus

Hence where is some constant. Since is even, we get that . Thus

This completes the proof.

**Remark:** One can even use asymmetric iid random variables with similar tail conditions on both sider. For example,

where . Then also the limit converges to the (general) stable distribution. For the exact statement of the general result one may look at Gut[3].

**Application:** iid with density that is symmetric about and continuous and positive around . Then

**Proof:** Observe that

Thus the tail condition is satisfied with . Hence

where is symmetric stable with . Thus is Cauchy with appropiate parameters.

**Series representation**

**Theorem 10:** Let , and be three independent sequences of random variables where with probability each, are the arrival times of a homogenous poisson process with unit arrival rate, and are iid random variables satisfying . Then

where with characteristic function where is a computable constant depending only on .

**Proof:** We divide the proof into following three 3 steps

{**Step-1:**} (Almost sure convergence) We wish to apply Kolmogorov three series theorem. But ‘s are not independent. Note that . By strong law we have . Let . Then . We will show converges almost surely for each fixed sequence of belonging to the event . Fix such a sequence. We can get such that

Now let us apply Kolmogorov three series theorem. Let be the distribution of . For each ,

The last inequality is true as .

since the symmetric random variables is truncated expectation exists and hence zero.

Hence the series converges almost surely.

{**Step-2:**} Since the almost sure convergence is established. We will now show only that the distributional limit of the series is indeed a random variable. Since the ‘s are dependent, we will eliminate ‘s in this step. We will use a well known result from Poisson process. Recall that conditional on are distributed as ordered statistics from . Hence

is conditionally distributed as ordered statistics from . Now the conditional distribution does not depend on . Thus

and it is independent of . Therefore

Since by SLLN , it is enough to consider the series

{**Step-3:**} Since we know that the original series converges almost surely it is enough to find the distributional limit of . Clearly we should apply the Generalised CLT. So it is enough to verify whether the random variables are symmetric and satisfy tail conditions. Since takes values with probability each. It forces to be symmetric. Note that

Observe that

The right side goes to zero as by DCT. Thus

Hence invoking Generalised CLT we get that distributional limit is a random variable. This completes the proof.

**Concluding Remarks**

Let us summarize what we did so far. We introduce stable distributions, discuss some of its properties like characteristic functions, tail behaviour and moment properties and then proved the generalised CLT. However our last result, series representation is quite different. Just like multivariate Gaussian distribution, multivariate , multivariate , we have the notion of multivariate stable distributions. Multivariate distributions are needed to model multivariate data, In general we have the notion of stochastic process which takes into account of infinite collection of random variables. We call a process to be a random field when the index set is multidimensional. A popular process / random field where the random variables are continuous is the Gaussian process, where any finite dimensional marginal is multivariate Gaussian. But one of the drawbacks of Gaussian process is that we need to assume finiteness of second moments. So in the case of heavy tailed data it is incorrect to use Gaussian process to model them. That is where Stable process / Stable random field comes into picture. Stable process have all finite dimensional marginals as multivariate stable. They are useful to model heavy tailed data and hence they have been well studied in literature. The series representation theorem is the starting point of random field literature. It helps us to relate with the well known Poisson process and hence helps us to derive some of the important results in random field theory.

**References**

- Durrett, Rick.
*Probability: theory and examples*. Cambridge university press, 2010. - Feller, William.
*Introduction to Probability Theory and Its Appl. II.*New York (1971). - Gut, Allan.
*Probability: a graduate course.*Vol. 75. Springer Science & Business Media, 2012. - Roy, Parthanil.
*Maxima of stable random fields, nonsingular actions and finitely generated abelian groups: A survey.*arXiv preprint arXiv:1702.00393 (2017). - Samorodnitsky, Gennady, and Murad S. Taqqu.
*Stable non-Gaussian random processes: stochastic models with infinite variance.*Vol. 1. CRC press, 1994.