IoT Inspector Local

IoT Inspector that works without the cloud.

Usage from an end-user's perspective

Run IoT Inspector Local on a participant's computer.
Open the AR app on an iPhone that is connected to the same network.

Usage from the researcher's perspective

Ask participant to do the following:

Run IoT Inspector Local; see src/README.md for instructions.
Copy down the IP address displayed on IoT Inspector's terminal window. Let's say this IP is 10.0.0.X.

Do the following from the AR app:

Issue an HTTP GET request to http://10.0.0.X:46241/is_ready. Upon error, check again in a second or two.
Assuming no error, the response should be a JSON object: {"status": "OK"}.
Issue an HTTP GET request to http://10.0.0.X:46241/get_device_list. The response should be a JSON object in the form of:
```
{
    "abc001": {
        "device_id": "abc001",
        "device_ip": "10.0.0.5",
        "device_vendor": "Google",      // name based on device's MAC address
        "netdisco_name": "Google Home", // name inferred from a device's SSDP/mDNS 
        "dhcp_name": "",                // name obtained from DHCP Requests   
        "is_inspected": true            // whether we are collecting traffic
    },
    "def002": {
        "device_id": "def002",
        "device_ip": "10.0.0.6",
        "device_vendor": "",
        "netdisco_name": "",
        "dhcp_name": "",
        "is_inspected": false
    }
}
```
Note that the JSON object above constantly changes, as IoT Inspector scans for more devices. Examples of changes include:
- New additions of devices. In fact, when you request http://10.0.0.X:46241/get_device_list for the first time, you will likely get back {}, since IoT Inspector is still in the process of scanning for new devices.
- Updates to device names. For example, you might get an empty string in netdisco_name, but a few seconds later it becomes Smart TV.
Because of the changes above, it is recommended that the AR app requests http://10.0.0.X:46241/get_device_list as often as possible.
From the device list, decide which devices are of interest. For example, take a look at all the device_name fields and identify all the smart TVs and Google Homes. Remember their device_ids.
Let's say you're interested in the Google Home, whose device_id is abc001. Issue an HTTP GET request to http://10.0.0.:46241X/enable_inspection/abc001, which should return a JSON object: {"status": "OK"}. Repeat this step for each device of interest. This step basically instructs IoT Inspector to start capturing network traffic for each device of interest. Each inspected device will have the is_inspected field set as true upon /get_device_list.

To see what traffic has been captured, issue an HTTP GET request to http://10.0.0.X:46241/get_traffic once every few seconds, which returns a JSON object in the form of:

{
    'abc001': 
        {
            "72.12.13.14": {
                "hostname": "server1.googleusercontents.com",
                "short_domain": "googleusercontents.com",
                "owner_company": "Google",
                "ip_country_code": "US",
                "purpose": "",
                "is_tracking": false
            },
            "35.112.131.5": {
                "hostname": "server1.fbcdn.com",
                "short_domain": "fbcdn.com",
                "owner_company": "Facebook",
                "ip_country_code": "US",
                "purpose": "",
                "is_tracking": true
            },

        },
}

This JSON object shows all destinations visited by every inspected device since http://10.0.0.X:46241/get_traffic was called the last time. Note that is_tracking indicates that IP address is an advertising or tracking service. Any of the fields above could be empty, because IoT Inspector has no information, or the feature is not implemented yet.

I suggest requesting http://10.0.0.X:46241/get_traffic roughly once every two seconds to get an updated view of the traffic.

When you are no longer interested in a device, say abc001, issue an HTTP GET request to http://10.0.0.X:46241/disable_inspection/abc001.
When the AR app quits, issue an HTTP GET request to http://10.0.0.X:46241/shutdown to terminate IoT Inspector.

Summary of IoT Inspector's HTTP API

/is_ready: Checks if IoT Inspector is ready to interface with the AR app.
/get_device_list: Returns a list of devices and constantly changes.
/enable_inspection/[device_id]: Instructs IoT Inspector to start collecting network traffic from a given device_id.
/get_traffic: Returns network traffic from every inspected device between the last time you called this API and now.
/disable_inspection/[device_id]: Instructs IoT Inspector to stop collecting network traffic from a given device_id.
/shutdown: Stops inspecting all traffic and quits IoT Inspector Local.
/block_device/[device_id]/[start_unix_ts]/[stop_unix_ts]: Sends wrong spoofed ARP packets to device_id (effectively blocking the device) between two UNIX timestamps (epoch). You can call this function multiple times to update the start and stop timestamps.
/unblock_device/[device_id]: Unblocks that device.
/list_blocked_devices: Shows a list of blocked device_ids.

Real example of the API in action

http://10.0.0.X:46241/get_device_list


{
  "s91dc4b3c7c": {
    "device_id": "s91dc4b3c7c",
    "device_ip": "10.0.0.6",
    "device_vendor": "Google, Inc.",
    "netdisco_name": "",
    "dhcp_name": "",
    "is_inspected": false
  },
  "s244f64171a": {
    "device_id": "s244f64171a",
    "device_ip": "10.0.0.2",
    "device_vendor": "",
    "netdisco_name": "",
    "dhcp_name": "",
    "is_inspected": true
  },
  "sf0856cc210": {
    "device_id": "sf0856cc210",
    "device_ip": "10.0.0.4",
    "device_vendor": "Espressif Inc.",
    "netdisco_name": "",
    "dhcp_name": "",
    "is_inspected": false
  },
  "s23db5e4db3": {
    "device_id": "s23db5e4db3",
    "device_ip": "10.0.0.3",
    "device_vendor": "Espressif Inc.",
    "netdisco_name": "",
    "dhcp_name": "",
    "is_inspected": false
  }
}

http://10.0.0.X:46241/enable_inspection/s244f64171a

{"status": "OK"}

http://10.0.0.X:46241/get_traffic


{
  "s244f64171a": {
    "10.0.0.1": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "172.217.10.2": {
      "hostname": "googleads.g.doubleclick.net",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "34.237.79.93": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "52.3.159.233": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "34.192.207.8": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "104.244.39.20": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "52.4.57.223": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "34.193.175.208": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "151.101.208.81": {
      "hostname": "www.bbc.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "23.47.146.179": {
      "hostname": "nav.files.bbci.co.uk",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "23.41.189.38": {
      "hostname": "cdn.optimizely.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "216.200.232.114": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "172.217.10.14": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "54.85.197.32": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "195.181.169.26": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "159.127.43.76": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "69.147.82.60": {
      "hostname": "beap-bc.yahoo.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "151.101.209.164": {
      "hostname": "www.nytimes.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "143.204.149.174": {
      "hostname": "c.amazon-adsystem.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "142.250.64.83": {
      "hostname": "a.et.nytimes.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "142.250.64.78": {
      "hostname": "clients4.google.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "35.244.188.62": {
      "hostname": "als-svc.nytimes.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "23.193.217.21": {
      "hostname": "contextual.media.net",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "172.217.11.2": {
      "hostname": "securepubads.g.doubleclick.net",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "172.217.10.136": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "23.192.4.141": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "13.33.60.43": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    },
    "35.241.35.241": {
      "hostname": "meter-svc.nytimes.com",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    }
  },
  "s4b24c33dd7": {
    "10.0.0.2": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    }
  },
  "s91dc4b3c7c": {
    "224.0.0.251": {
      "hostname": "",
      "short_domain": "",
      "owner_company": "",
      "ip_country_code": "",
      "purpose": "",
      "is_tracking": ""
    }
  }
}

Contact

Questions? Email Danny Y. Huang at dhuang@nyu.edu.

msrivastava / iot-inspector-local