May 12th, 2020
When I got first introduced to differential equations, I had a lovehate relationship with it. Mainly due to some backofthebook problems we were given and neverending projects we were assigned to. After some time, differential equations is a way to truly understand physics and the foundations of gravity, fields, and everything. This articles is merely an intro on manually solving common forms of differential equations. Hope you enjoy
Quick notes

\(f_x \iff \partial_x f\)

\(A,B,C\) are usually constants

\(c_k\) is usually solution’s constant that is defined with initial conditions

Most of the functions are \(\mathbb{R}^k \to \mathbb{R}\), \(k \in \mathbb{N}^+\)

If you found a typo or want to comment, feel free to email me. Email on top of the page.
Firstorder, linear
Those equations have the form: \(y' + p(t) y = q(t)\)
Find \(\mu(t) = e^{\int p(t) dt}\)
Then \(\frac{d}{dt}(\mu(t)y) = q(t) \mu(t)\) \(\implies y = \frac{\int q(t) \mu(t) dt}{\mu(t)}\)
Firstorder, separable
Those equations have the form: \(\frac{dy}{dx} = f(x)g(y)\)
Find the solution by solving \(\int \frac{dy}{g(y)} = \int f(x) dx\)
Solve for exact (explicit) values of \(y\)
Exact equations
They have the form \(M(x,y) + N(x,y) \frac{dy}{dx} = 0\)

\((\xi)\) If \(M_y = N_y\)
\(\implies\) Find such \(F(x,y)=C\), where \(F_x = M\), \(F_y = N\)

otherwise, make it exact, such that
\(\frac{M_yN_x}{N}\) only depends on \(x\) or \(\frac{N_xM_y}{M}\) only depends on \(y\)
Find \(\mu(x) = e^{\int \frac{M_yN_x}{N} dx}\) or \(\mu(y) = e^{\int \frac{N_xM_y}{M} dy}\), multiply both by \(M\) and \(N\), so the condition \(M_y = N_y\) is satisfied. Go to \((\xi)\) and proceed with finding \(F(x,y)\)
Secondorder, linear, constantcoefficient equations
They have the form \(y'' + p y' + q y = f(t)\)

First, solve for the homogeneous case, where \(y'' + p y' + q y = 0\)
Make a characteristic polynomial, let \(y = e^{rt}\):
\(r^2+pr+q=0\)
Find roots, solution (general) will be \(y = c_1 e^{r_1 t} + c_2 e^{r_2 t}\)

if repeated root \(\implies y = c_1 e^{rt} + c_2 t e^{rt}\)

if \(r = \alpha \pm i \beta\) \(\implies y=c_1 \cos(\beta t)e^{\alpha t} + c_2 \sin(\beta t) e^{\alpha t}\)


Solving for particular solution \(y_p(t)\)

Undetermined coefficients (superpositioned) for \(f(t)\)
Whatever is in \(f(t)\), start adding up the corresponding coefficients into \(y_p(t)\)

\(e^{nt} \to Ae^{nt}\)

\(t^m \to A_m t^m + \ldots + A_1 t + A_0\)

\(\cos(\beta t)\) or \(\sin(\beta t) \to Acos(\beta t) + B\sin(\beta t)\)
Noteshould not be linearly dependent with the general solution. If it is, multiply by \(t\) until it is linearly independent.


Variation of parameters
Seek \(y_p(t) = v_1(t)y_1(t)+v_2(t)y_2(t)\), where
\(\begin{cases}v_1’y_1+v_2’y_2=0\\v_1’y_1'+v_2’y_2'=f(t)\end{cases}\)

So the final solution is \(y(t)=c_1 y_1(t) + c_2 y_2(t) + y_p(t)\)
Secondorder, linear, variablecoefficient equations
Equations have the form

\((1)\): \(a(t)y'' + b(t)y'+c(t)y = f(t)\)

\((2)\): \(y'' + p(t)y'+q(t)y = g(t)\)
In general case, guess the first homogeneous solution (try \(y_1=e^t\)) and use reduction of order to find the second homogeneous solution, so that
\(y_2(t) = v(t)y_1(t)\)
\(\implies y_2'' + p(t)y_2' + q(t)y_2 = 0\)
\(\implies (v(t)y_1(t))''+p(t)(v(t)y_1(t))'+q(t)(v(t)y_1(t))=0\)
Note

Also applicable with form \((1)\) 
You will probably have another differential equation emerge from above. It should have lower order than our current equation, so just refer to one of the techniques above to find \(v(t)\) and then you can find \(y_2(t)=v(t)y_1(t)\)
Use variation of parameters to find a particular solution. It’s that system with \(v\)
Note

What you if you have a CauchyEuler equation? 
They have the form \(at^2y''+bty'+cy=0\)
then \(y=t^r \implies ar^2+(ba)r+c=0\)

if \(r\) is repeated, \(y_1=t^r\), \(y_2=lntt^r\)

if \(r=\alpha\pm i\beta\), \(y_1=t^{\alpha}\cos(\beta lnt)\) and \(y_2=t^{\alpha}\sin(\beta lnt)\)
Generally, solution has the form \(y=c_1t^{r_1}+c_2t{r_2}\)
Higherorder, linear equations
\(a_n(t)y^{(n)}a_{n1}(t)y^{(n1)}\ldots+a_1(t)y'+a_0(t)y=g(t)\)
All secondorder methods above extend to \(n^{th}\) order.
Laplace transform
Laplace is a holy grail of solving differential equations with initial values defined. Laplace is the same kind of Bible to engineers like Taylor Series is.
\(\mathcal{L}{f}(s) = \int_0^{\infty} e^{st} f(t) dt\)
assuming \(f\) is piecewise continuous and of exponential order.
Table of common transformations:
\(f(t)\)  \(\mathcal{L}{f}(s)\) 

\(1\) 
\(\frac{1}{s}\) 
\(e^{at}\) 
\(\frac{1}{sa}\) 
\(\sin(bt)\) 
\(\frac{b}{s^2+b2}\) 
\(\cos(bt)\) 
\(\frac{s}{s^2+b2}\) 
\(u(ta)\) 
\(\frac{e^{as}}{s}\) 
\(\delta(ta)\) 
\(e^{as}\) 
Where \(u(t)\) is the Heaviside step function and \(\delta(t)\) is the Dirac delta function.
Some Laplace transform properties:

\(\mathcal{L}\{e^{at}f(t)\}(s) = \mathcal{L}\{f(t)\}(sa)\)

\(\mathcal{L}\{t^nf(t)\}(s) = s^n\mathcal{L}{f}(s)s{n1}f(0)\ldotssf^{(n2)}(0)f{(n1)}(0)\)

\(\mathcal{L}\{t^nf(t)\}(s) = (1)^n \frac{d^n}{dsn} \mathcal{L}\{f(t)\}(s)\)
If \(f\) is a Tperiodic function,
\(\mathcal{L}\{f(t)\}(s) = \frac{\int_0^T e^{sT} f(t) dt}{1e^{sT}}\)
where \(\int_0^T e^{sT} f(t) dt = \mathcal{L}\{f_T(t)\}(s)\), the sum of integrals of different parts of the piecewise function.
Convolutions:

\((f*g)(t) = \int_0^t f(tv)g(v)dv\)

\(\mathcal{L}\{(f*g)(t)\} = \mathcal{L}\{f(t)\}(s)\cdot \mathcal{L}\{g(t)\}(s)\)

\((f*g)(t) = \mathcal{L}^{1}\{F\cdot G\}(t)\), where \(F=\mathcal{L}{f}(s)\) and \(G=\mathcal{L}{g}(s)\)
Heaviside/unit step function:

\(\mathcal{L}\{u(ta)f(t)\}(s) = e^{as}\mathcal{L}\{f(t+a)\}(s)\)

\(\mathcal{L}^{1}\{e{as}F(s)\}(t)=u(ta)\mathcal{L}^{1}\{F(s)\}(ta)\)
If IVP is not at 0, define some new function like \(w(t)=y(t+\alpha)\), and solve for \(w\). Finally, you can offset to find \(y\)
Step (block) function:

\(\Pi_{a,b}(t) = u(ta)u(tb)\)

\(\mathcal{L}\{\Pi_{a,b}(t)\}(s)=\frac{e^{sa}e{sb}}{s}\)
Constantcoefficient, homogeneous systems of ODE
\(\vec{x}' = A \vec{x}\), where \(A\in\mathbb{R}^{n\times n}\), \(x\in\mathbb{R}^n\)
If \(A\) has n linearly independent eigenvectors \(\vec{u_i}\) associated to n eigenvalues \(\lambda_i\), then a general solution of the system is given by \(\vec{x}(t) = c_1 e^{\lambda_1 t}\vec{u_1}+c_2e^{\lambda_2t}\vec{u_2} + \ldots + c_ne^{\lambda_nt}\vec{u_n}\)

If \(\lambda=\alpha \pm i \beta\), so \(\vec{u}=\vec{a}+i\vec{b}\), we have
\(\vec{x}=c_1e^{\alpha t}(\cos(\beta t)\vec{a}\sin(\beta t)\vec{b}) + c_2e^{\alpha t}(\cos(\beta t)\vec{b}+\sin(\beta t)\vec{a})\)

Matrix exponential
\(e^{At} = \sum_{k=0}^{\infty} \frac{A^k t^k}{k!}\), where \(A^0=I\), an identity matrix.

Find solutions for any eigenvalues

Compute the characteristic polynomial \(p(\lambda)\) of \(A\)
\(p(\lambda)=det(A\lambda I)\)

Factor \(p(\lambda)\) into linear factors to yield
\(p(\lambda) = c(\lambda\lambda_1)^{m_1} \cdot \ldots \cdot (\lambda\lambda_k)^{m_k}\), where \(c=\pm 1\)

For each \(\lambda_j\), find \(m_j\) linearly independent generalized eigenvectors \(\{\vec{u_j}^{m_1},\cdots,\vec{u_j}{m_j}\}\) satisfying
\((A\lambda_i I)^{m_j} \vec{u} = \vec{0}\)

For each \(\vec{u_j}^i\) computed in the previous step, compute \(e^{At}\vec{u_j}i\) by
\(e^{At}\vec{u_j}i\)
\(=e^{\lambda_jt}e{(A\lambda_jI)t}\vec{u_j}^i\)
\(=e^{\lambda_jt}(\vec{u_j}i+t(A\lambda_jI)\vec{u_j}^i+\cdots+\frac{t{m_j1}}{(m_j1)!}(A\lambda_jI)^{m_j1}\vec{u_j}i)\)

Linear systems of ODE
\(\vec{x}' = A(t)\vec{x} + \vec{f}(t)\), where \(A\in\mathbb{R}^{n\times n}\), \(x\in\mathbb{R}^n\), \(f\in\mathbb{R}^n\)
If \(X(t)\) is a matrix whose columns are made up of n linearly independent homogeneous solutions (\(X(t)\) is the fundamental matrix), then a general solution may be written as \(\vec{x}(t_0)=\vec{x_0}\)
\(\vec{x}(t) = X(t)X^{1}(t_0)\vec{x_0}+X(t)\int_{t_0}{t}X^{1}(s)f(s)ds\)
If \(A(t)\) is constantcoefficient, then we recover Duhamel’s formula:
\(\vec{x}(t) = e^{A(tt_0)}x_0 + \int_{t_0}^{t}e{A(ts)}f(s)ds\)
Applications
There are many applications of differential equations in classical mechanics, fields, etc. Below you will find just a snippet of some very common Physics 1/2 scenarios

Falling object
\(m\frac{dv}{dt}=mgbv\), where \(b\) is the air resistance

Fluid mix, define \(R_{in}\) and \(R_{out}\)
\(\frac{dx}{dt}=R_{in}R_{out}\)

MassSpring System

Vertical spring (direction of gravity)
\(my''=by'k(L+y)+mg+F_{ext}(t)\), assume \(KL=mg\), where \(b\) is dumping, and \(k\) is stiffness

Horizontal spring
\(my''=by'ky+F_{ext}(t)\), where \(b\) is dumping, and \(k\) is stiffness

Conclusion
This is as much as I can recover from my initial experience with differential equations. This article is not as much to teach you how to solve them but provide a quick lookup cheatsheet if needed or glance at different forms that we can actually solve! There are infinitely many differential equations that we cannot find an exact solution for!