Detecting Process Injection using Microsoft Detour Hooks

Introduction
​Microsoft Detours "is a software package for monitoring and instrumenting API calls on Windows". The package provides a generic and safe way to implement hooks for x86 and x64 Windows APIs, allowing for monitoring, tampering, or anything else that you'd want to do with an API hook.
This blog post will cover how to get started with detours, with the objective of being able to detect and prevent a typical example of process injection used by common attack frameworks. We'll build a DLL that when loaded into a process will hook the relevant API calls, and then kill the host process if the sequence of API calls indicates that process injection is about to occur.
To put it another way, we will try and create the most basic, simplistic, and probably incorrect example of a "Next-Generation Anti-Virus" (NGAV). Suffice to say the content of this blog should not be taken with any seriousness in terms of detecting real threats; it does not factor in performance, stability, false positives, or any of the other factors that enterprise security products have to address.
Getting Started with Detours
Hooking MessageBoxA
Getting started with Detours is very simple, we can use NuGet to install the package and the we just need to include the library at the start of our project file:
After we've added the library to our project we can hook our first function. For this initial proof of concept we will build a DLL that when injected into a process will hook the MessageBoxA function:
1
#include "windows.h"
2
#include "detours.h"
3
​
4
// Remap MessageBoxA to a new function name
5
INT(WINAPI* oMessageBoxA)(HWND,LPCSTR,LPCSTR,UINT) = MessageBoxA;
6
​
7
// Define our hook, match return code and parameters
8
int WINAPI hookedMessageBoxA(HWND hWnd,LPCSTR lpText,LPCSTR lpCaption,UINT uType)
9
{
10
    // Do our "evil"
11
    // Change the text of the MessageBox
12
    lpText = "Hooked!";
13
    return oMessageBoxA(hWnd,lpText,lpCaption,uType);
14
}
15
​
16
BOOL APIENTRY DllMain(HMODULE hModule,
17
    DWORD  ul_reason_for_call,
18
    LPVOID lpReserved
19
)
20
{
21
    switch (ul_reason_for_call)
22
    {
23
    case DLL_PROCESS_ATTACH:
24
    {
25
        // Initialise detours and commit them
26
        DetourTransactionBegin();
27
        DetourUpdateThread(GetCurrentThread());
28
        DetourAttach(&(PVOID&)oMessageBoxA, hookedMessageBoxA);
29
​
30
        LONG lError = DetourTransactionCommit();
31
        if (lError != NO_ERROR) {
32
            MessageBox(HWND_DESKTOP, L"Could not add detour", L"Detour Error", MB_OK);
33
            return FALSE;
34
        }
35
    }
36
    case DLL_THREAD_ATTACH:
37
    case DLL_THREAD_DETACH:
38
    case DLL_PROCESS_DETACH:
39
        break;
40
    }
41
    return TRUE;
42
}
Copied!
Implementing our first function hook is trivial as we can see from the code snippet above. The majority of the code is just boiler plate DLL code, but lines 5 - 13 are what we really care about. On line 5 we define a new function to map to the original MessageBoxA function, this allows us to call the original function after our hook has run. Note that it has the same return code and parameters as the real MessageBoxA function:
Lines 7 - 13 are where we define our "hook" code. We copy the return code and parameters of the real MessageBoxA function, do our "evil" (in this case changing the text displayed in the text box to 'Hooked!') and then return execution back to the original MessageBoxA function. 
Finally, to implement the actual hook we call DetourTransactionBegin(), DetourUpdateThread(), DetourAttach() and DetourTransactionCommit() on lines 26 - 30. That's all that's needed to set up our hook, considerably easier that doing it all manually eh? 
Now that we have a DLL that we can inject into a process to initiate our hook, let's test it out to make sure it works. In the screenshot below I created a simple program that will call MessageBoxA and display the text "Hi". It will then wait for user input and then display the message box again. In the break while it's waiting for user input, we can inject our DLL using Process Hacker, and if our hook works then the second call to MessageBoxA should have its text change to "Hooked!". 
MessageBoxA Demo
Detecting Process Injection
Now that we know how to hook APIs using Detours we can try something a little more interesting than just hooking MessageBoxA. Instead, let's create a DLL that - when injected into a process - will hook the common API calls used for process injection, and then kill the host process if process injection is about to occur. 
Process Injection Primer 
Discussing process injection (and the different variations) in detail is outside of the scope of this blog post in an attempt to keep the length of this post reasonable. In a nutshell typical process injection utilises the following API calls:
1.OpenProcess - Used to get a handle to the target process of the process injection.
2.VirtualAllocEx - Used to allocation memory in the target process to hold the payload.
3.WriteProcessMemory - Used to write the payload to the memory region in the target process.
4.CreateRemoteThreadEx - Used o create a thread in the target process to execute the payload memory region. 
Ten process injection techniques: A technical survey of common and trending process injection techniques
Elastic Blog
Building our DLL
1
#include <windows.h>
2
#include "detours.h"
3
​
4
BOOL openProcessCalled = FALSE;
5
BOOL virtualAllocExCalled = FALSE;
6
BOOL writeProcessMemoryCalled = FALSE;
7
BOOL createRemoteThreadExCalled = FALSE;
8
​
9
// Hooked API calls related to standard process injection
10
LPVOID(WINAPI* oOpenProcess)(DWORD, BOOL, DWORD) = OpenProcess;
11
LPVOID(WINAPI* oVirtualAllocEx)(HANDLE, LPVOID, SIZE_T, DWORD, DWORD) = VirtualAllocEx;
12
BOOL(WINAPI* oWriteProcessMemory)(HANDLE, LPVOID,LPCVOID,SIZE_T,SIZE_T*) = WriteProcessMemory;
13
HANDLE(WINAPI* oCreateRemoteThreadEx)(HANDLE, LPSECURITY_ATTRIBUTES, SIZE_T, LPTHREAD_START_ROUTINE, LPVOID, DWORD, LPPROC_THREAD_ATTRIBUTE_LIST, LPDWORD) = CreateRemoteThreadEx;
14
​
15
// Our hook function for OpenProcess
16
LPVOID WINAPI hookedOpenProcess(DWORD dwDesiredAccess,BOOL bInheritHandle,DWORD dwProcessId)
17
{
18
    openProcessCalled = TRUE;
19
    return oOpenProcess(dwDesiredAccess,bInheritHandle,dwProcessId);
20
}
21
​
22
// Our hook function for VirtualAllocEx
23
LPVOID WINAPI hookedVirtualAllocEx(HANDLE hProcess, LPVOID lpAddress, SIZE_T dwSize, DWORD flAllocationType, DWORD flProtect)
24
{
25
    virtualAllocExCalled = TRUE;
26
    return oVirtualAllocEx(hProcess, lpAddress, dwSize, flAllocationType, flProtect);
27
}
28
​
29
// Our hook function for WriteProcessMemory
30
BOOL WINAPI hookedWriteProcessMemory(HANDLE hProcess, LPVOID lpBaseAddress, LPCVOID lpBuffer, SIZE_T nSize, SIZE_T* lpNumberOfBytesWritten)
31
{
32
    writeProcessMemoryCalled = TRUE;
33
    return oWriteProcessMemory(hProcess,lpBaseAddress,lpBuffer,nSize,lpNumberOfBytesWritten);
34
}
35
​
36
// Our hook function for CreateRemoteThreadEx
37
HANDLE WINAPI hookedCreateRemoteThreadEx(HANDLE hProcess, LPSECURITY_ATTRIBUTES lpThreadAttributes, SIZE_T dwStackSize, LPTHREAD_START_ROUTINE lpStartAddress, LPVOID lpParameter, DWORD dwCreationFlags, LPPROC_THREAD_ATTRIBUTE_LIST lpAttributeList, LPDWORD lpThreadId)
38
{
39
    // Naive logic to see if the APIs related process injection have been called
40
    // This is a very hacky PoC chaeck 
41
    if (openProcessCalled && virtualAllocExCalled && writeProcessMemoryCalled) {
42
    
43
        // Setup to reflective injection detected. Kill the process
44
		    MessageBox(HWND_DESKTOP, L"Reflective injection detected. Killing Process.", L"Poor Mans NGAV", MB_OK);
45
        DWORD killPid = GetCurrentProcessId();
46
        HANDLE hKillProcess = OpenProcess(PROCESS_ALL_ACCESS, FALSE, killPid);
47
        TerminateProcess(hKillProcess, 0);
48
    }
49
    return oCreateRemoteThreadEx(hProcess, lpThreadAttributes, dwStackSize, lpStartAddress, lpParameter, dwCreationFlags, lpAttributeList,lpThreadId);
50
}
51
​
52
BOOL APIENTRY DllMain( HMODULE hModule,
53
                       DWORD  ul_reason_for_call,
54
                       LPVOID lpReserved
55
                     )
56
{
57
    switch (ul_reason_for_call)
58
    {
59
    case DLL_PROCESS_ATTACH:
60
    {
61
        // Apply our hooks
62
        DetourTransactionBegin();
63
        DetourUpdateThread(GetCurrentThread());
64
        DetourAttach(&(PVOID&)oOpenProcess, hookedOpenProcess);
65
        DetourAttach(&(PVOID&)oVirtualAllocEx, hookedVirtualAllocEx);
66
        DetourAttach(&(PVOID&)oWriteProcessMemory, hookedWriteProcessMemory);
67
        DetourAttach(&(PVOID&)oCreateRemoteThreadEx, hookedCreateRemoteThreadEx);
68
​
69
        LONG lError = DetourTransactionCommit();
70
        if (lError != NO_ERROR) {
71
            MessageBox(HWND_DESKTOP, L"Could not add detour", L"Detour Error", MB_OK);
72
            return FALSE;
73
        }
74
    }
75
    case DLL_THREAD_ATTACH:
76
    case DLL_THREAD_DETACH:
77
    case DLL_PROCESS_DETACH:
78
        break;
79
    }
80
    return TRUE;
81
}
Copied!
The code above is by no means safe to use in any meaningful way. It is simply an example of how hooking could be used to detect/prevent process injection. False positives and performance issues have not even slightly been considered.
The code above is a fairly straight forward extension to the MessageBoxA example that we built previously, except instead of just hooking the MessageBoxA function we are hooking the API calls that take place in the lead up to process injection.
For the most part the majority of our API hooks just toggle a boolean which allows us to track which APIs have been called. Then in line 41 - in the hook for the CreateRemoteThreadEx API - we have some simple logic that checks whether all of the other APIs have been called. If they have, then we get a handle to the current process and kill it. All going well, when we inject this DLL into a process, if that process attempts to perform process injection we should be able to catch the behaviour and kill the host process before the injection occurs.
Does it Work?
To test whether our DLL will work correctly we need a simple way to perform process injection. Fortunately we can stand on the shoulders of other people's research and use the Invoke-ReflectivePEInjection Powershell script from PowerSploit:
PowerSploit/Invoke-ReflectivePEInjection.ps1 at master · PowerShellMafia/PowerSploit
GitHub
Before we use the process injection script we need to load our DLL into the Powershell process memory space. To simplify this process and to emulate a poor man's NGAV, I built a simple "supervisor" program that will inject our DLL into any powershell processes that are created. 
Process Injection without our Hook
Process Injection with our Hook
As you can see from the GIF above, our supervisor service injected our DLL into the powershell process that was created. When we then tried to use the Invoke-ReflectivePEInjection script to inject into another process, our hooks detected the lead up to the process injection and then ultimately killed the process!
References
GitHub - microsoft/Detours: Detours is a software package for monitoring and instrumenting API calls on Windows.  It is distributed in source code form.
GitHub
Ten process injection techniques: A technical survey of common and trending process injection techniques
Elastic Blog
​
​
​