Juniper / open-nti

Open Network Telemetry Collector build with open source tools

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Discarding Points

mcaulifn opened this issue · comments

I'm getting a lot of these errors with multiple sensors configured:

2018-08-01T13:12:05Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points

Sensor config:

  sensors = [
   "junos-cpu /junos/system/cpu/memory/",
   "junos-linecard-packet /junos/system/linecard/packet/usage/",
   "junos-linecard-fabric /junos/system/linecard/fabric/",
   "oc-bgp /bgp",
   "oc-interfaces /interfaces/interface/[name='fxp0'] /interfaces/interface/[name='xe-0/0/0'] /interfaces/interface/[name='xe-0/0/1'] /interfaces/interface/[name='gr-0/0/0']",
   "oc-components /components/"
  ]

Hi

Try to put oc-interfaces like that:

"oc-interfaces /interfaces/interface[name='xe-0/0/0']/","/interfaces/interface[name='fxp0']/","/interfaces/interface/[name='xe-0/0/1']","/interfaces/interface/[name='gr-0/0/0']",

Regards

I updated the configuration. However, that was only one example. Here is another one not related to interfaces:

2018-08-01T14:26:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-packet" is type string, already exists as type integer dropped=31; discarding points

2018-08-01T14:43:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-bgp" is type integer, already exists as type string dropped=2; discarding points

Based on what I'm finding, it appears as if all fields are applied to all measurements.

Could you show me an example about all fields being applied to all measurements ?

Thanks

My recommendation is:

  1. Stop input-oc container
  2. Log in the influxdb container and delete all measurements (i.e DROP MEASUREMENT "oc-interfaces";) - I don't recall if you have to add ; at the end or not.
  3. Configure the sensors in your file (the syntax you use (identifier) is correct )
  4. Start again input-oc container
  5. Check if fields are applied to all measurements or by the contrary is being correctly applied.

Regards.

I deleted all measurements from the juniper DB. I'm no longer seeing a bunch of extra fields like I was. However, I'm still getting the errors:

2018-08-02T11:20:48Z I! Starting Telegraf v1.7.2
2018-08-02T11:20:48Z I! Loaded inputs: inputs.jti_openconfig_telemetry
2018-08-02T11:20:48Z I! Loaded aggregators: 
2018-08-02T11:20:48Z I! Loaded processors: 
2018-08-02T11:20:48Z I! Loaded outputs: influxdb
2018-08-02T11:20:48Z I! Tags enabled: host=83410145023c
2018-08-02T11:20:48Z I! Agent Config: Interval:10s, Quiet:false, Hostname:"83410145023c", Flush Interval:5s 
2018-08-02T11:21:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-fabric" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:21:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:21:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-fabric" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:21:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:21:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-fabric" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:21:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:22:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:05Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:22:15Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-fabric" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:22:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:25Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:22:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:05Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:23:15Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:23:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:25Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:23:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:05Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:24:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:15Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:24:25Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:24:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:24:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:24:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:24:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:25:05Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:25:15Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:25:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "junos-linecard-fabric" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:25:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:45Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points
2018-08-02T11:25:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=4; discarding points
2018-08-02T11:25:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type integer, already exists as type string dropped=2; discarding points```

Could you please share you telegraf.conf ? What junos version are you using in your setup ?

Could you paste here the output of the following commands ?

show ephemeral-configuration
show agent sensors
and
MX-0(mx1_re vty)# show agent sensors (from inside PFE)

Regards

telegraf.txt

Junos: 18.1R1.9

services {
    analytics {
        export-profile export_1000 {
            transport grpc;
        }
        export-profile export_1003 {
            transport grpc;
        }
        export-profile export_1005 {
            transport grpc;
        }
        export-profile export_1007 {
            transport grpc;
        }
        export-profile export_1008 {
            transport grpc;
        }
        export-profile export_1009 {
            transport grpc;
        }
        export-profile export_1010 {
            transport grpc;
        }
        export-profile export_1002 {
            transport grpc;
        }
        export-profile export_1001 {
            transport grpc;
        }
        sensor sensor_1000 {
            export-name export_1000;
            resource /bgp/;
            subscription-id 1000;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1003 {
            export-name export_1003;
            resource /junos/system/linecard/packet/usage/;
            subscription-id 1003;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1005 {
            export-name export_1005;
            resource "/interfaces/interface/[name='xe-0/0/0']/";
            subscription-id 1005;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1007 {
            export-name export_1007;
            resource "/interfaces/interface/[name='fxp0']/";
            subscription-id 1007;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1008 {
            export-name export_1008;    
            resource /components/;
            subscription-id 1008;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1009 {
            export-name export_1009;
            resource /junos/system/linecard/packet/usage/;
            subscription-id 1009;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1010 {
            export-name export_1010;
            resource "/interfaces/interface/[name='gr-0/0/0']/";
            subscription-id 1010;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1002 {
            export-name export_1002;
            resource "/interfaces/interface/[name='xe-0/0/0']/";
            subscription-id 1002;
            reporting-rate 10;
            life-time long-lived;
        }
        sensor sensor_1001 {
            export-name export_1001;
            resource /bgp/neighbors/neighbor/;
            subscription-id 1001;
            reporting-rate 10;
            life-time long-lived;
        }
    }
}

show agent sensors 

Sensor Information : 
           
    Name                                    : __default_fabric_sensor__ 
    Resource                                : /junos/system/linecard/fabric/ 
    Version                                 : 1.0                  
    Sensor-id                               : 2277069355            
    Subscription-ID                         : 562952230490667      
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE                   
 
    Server Information : 
           
        Name                                : __default__snmp_server__ 
        Scope-id                            : 0                     
        Remote-Address                      : 0.0.0.0               
        Remote-port                         : 0                     
        Transport-protocol                  : UDP                   

    Profile Information : 
           
        Name                                : __default_snmp_export_profile__ 
        Reporting-interval                  : 30                    
        Payload-size                        : 5000                  
        Address                             : 0.0.0.0               
        Port                                : 0                     
        Timestamp                           : 0                     
        Format                              : GPB                   
        DSCP                                : 0                     
        Forwarding-class                    : 0                     
        Loss-priority                       : low                  

Sensor Information : 
           
    Name                                    : sensor_1000           
    Resource                                : /bgp/                 
    Version                                 : 1.0                  
    Sensor-id                               : 539528115             
    Subscription-ID                         : 1000                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : rpd                   

    Profile Information : 
           
        Name                                : export_1000           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1001           
    Resource                                : /bgp/neighbors/neighbor/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528114             
    Subscription-ID                         : 1001                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : rpd                   

    Profile Information :               
           
        Name                                : export_1001           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1002           
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528113             
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE,PFE,dcd,mib2d,xmlproxyd 

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1002_1_1       
    Resource                                : /junos/system/linecard/interface/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3141356889            
    Resource-filter                         : xe-0/0/0              
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : sensor_1002          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1002_1_2       
    Resource                                : /junos/system/linecard/interface/logical/usage/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3141356890            
    Resource-filter                         : xe-0/0/0              
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : sensor_1002          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   
                                        
Sensor Information : 
           
    Name                                    : sensor_1002_2_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3141353817            
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : sensor_1002          
    Component(s)                            : dcd                   

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1002_4_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3141359961            
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : sensor_1002          
    Component(s)                            : mib2d                 

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1002_6_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3141357913            
    Subscription-ID                         : 1002                 
    Parent-Sensor-Name                      : sensor_1002          
    Component(s)                            : xmlproxyd             

    Profile Information : 
           
        Name                                : export_1002           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1003           
    Resource                                : /junos/system/linecard/packet/usage/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528112             
    Subscription-ID                         : 1003                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1003           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005           
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528118             
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE,PFE,dcd,mib2d,xmlproxyd 

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005_1_1       
    Resource                                : /junos/system/linecard/interface/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3142405465            
    Resource-filter                         : xe-0/0/0              
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : sensor_1005          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005_1_2       
    Resource                                : /junos/system/linecard/interface/logical/usage/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3142405466            
    Resource-filter                         : xe-0/0/0              
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : sensor_1005          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005_2_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3142402393            
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : sensor_1005          
    Component(s)                            : dcd                   

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005_4_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3142408537            
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : sensor_1005          
    Component(s)                            : mib2d                 

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1005_6_1       
    Resource                                : /interfaces/interface/[name='xe-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3142406489            
    Subscription-ID                         : 1005                 
    Parent-Sensor-Name                      : sensor_1005          
    Component(s)                            : xmlproxyd             

    Profile Information : 
           
        Name                                : export_1005           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007           
    Resource                                : /interfaces/interface/[name='fxp0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528116             
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : chassisd              

    Profile Information : 
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007_1_1       
    Resource                                : /junos/system/linecard/interface/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3144502617            
    Resource-filter                         : fxp0                  
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : sensor_1007          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007_1_2       
    Resource                                : /junos/system/linecard/interface/logical/usage/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3144502618            
    Resource-filter                         : fxp0                  
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : sensor_1007          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007_2_1       
    Resource                                : /interfaces/interface/[name='fxp0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3144499545            
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : sensor_1007          
    Component(s)                            : dcd                   

    Profile Information :               
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007_4_1       
    Resource                                : /interfaces/interface/[name='fxp0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3144505689            
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : sensor_1007          
    Component(s)                            : mib2d                 

    Profile Information : 
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1007_6_1       
    Resource                                : /interfaces/interface/[name='fxp0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3144503641            
    Subscription-ID                         : 1007                 
    Parent-Sensor-Name                      : sensor_1007          
    Component(s)                            : xmlproxyd             

    Profile Information : 
           
        Name                                : export_1007           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1008           
    Resource                                : /components/          
    Version                                 : 1.0                  
    Sensor-id                               : 539528123             
    Subscription-ID                         : 1008                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : chassisd              

    Profile Information : 
           
        Name                                : export_1008           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
                                        
    Name                                    : sensor_1009           
    Resource                                : /junos/system/linecard/packet/usage/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528122             
    Subscription-ID                         : 1009                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1009           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010           
    Resource                                : /interfaces/interface/[name='gr-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 539528083             
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : Not applicable       
    Component(s)                            : PFE,PFE,dcd,mib2d,xmlproxyd 

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010_1_1       
    Resource                                : /junos/system/linecard/interface/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3105705305            
    Resource-filter                         : gr-0/0/0              
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : sensor_1010          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010_1_2       
    Resource                                : /junos/system/linecard/interface/logical/usage/ 
    Version                                 : 1.1                  
    Sensor-id                               : 3105705306            
    Resource-filter                         : gr-0/0/0              
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : sensor_1010          
    Component(s)                            : PFE                   

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010_2_1       
    Resource                                : /interfaces/interface/[name='gr-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3105702233            
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : sensor_1010          
    Component(s)                            : dcd                   

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010_4_1       
    Resource                                : /interfaces/interface/[name='gr-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3105708377            
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : sensor_1010          
    Component(s)                            : mib2d                 

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

Sensor Information : 
           
    Name                                    : sensor_1010_6_1       
    Resource                                : /interfaces/interface/[name='gr-0/0/0']/ 
    Version                                 : 1.0                  
    Sensor-id                               : 3105706329            
    Subscription-ID                         : 1010                 
    Parent-Sensor-Name                      : sensor_1010          
    Component(s)                            : xmlproxyd             

    Profile Information : 
           
        Name                                : export_1010           
        Reporting-interval                  : 10                    
        Payload-size                        : 5000                  
        Format                              : GPB                   

VMX-0(router_a vty)# show agent sensors           

 Jvision ID  Name
 ----------  --------------------------------
  539528112  sensor_1003           5000(992)
  539528114  sensor_1001           5000(992)
  539528122  sensor_1009           5000(992)
 2277069355  __default_fabric_sensor__  5000(92)
 3105705305  sensor_1010_1_1       5000(459)
 3105705306  sensor_1010_1_2       5000(274)
 3141356889  sensor_1002_1_1       5000(460)
 3141356890  sensor_1002_1_2       5000(200)
 3142405465  sensor_1005_1_1       5000(460)
 3142405466  sensor_1005_1_2       5000(200)
 3144502617  sensor_1007_1_1       5000(0)
 3144502618  sensor_1007_1_2       5000(0)

Total number of jvision SENSORs = 12

 Non-JV  ID  Name
 ----------  --------------------------------

Total number of non-jvision SENSORs = 0

Please try the following:

  1. Stop everything (make stop)

  2. Add the following snippet to the telegraf config file (in the output plugins section)

    [[outputs.file]]

    files = ["stdout", "/tmp/metrics.out"]
    data_format = "influx"

  3. Start open-nti (make build-oc + make start)

  4. Verify if the error persist and attach metrics.out file

Here are the errors. Can I email the metrics file?

docker logs 4d2d0ab3fc73 | grep discarding
2018-08-02T15:19:09Z I! Starting Telegraf v1.7.2
2018-08-02T15:19:09Z I! Loaded inputs: inputs.jti_openconfig_telemetry
2018-08-02T15:19:09Z I! Loaded aggregators: 
2018-08-02T15:19:09Z I! Loaded processors: 
2018-08-02T15:19:09Z I! Loaded outputs: influxdb file
2018-08-02T15:19:09Z I! Tags enabled: host=4d2d0ab3fc73
2018-08-02T15:19:09Z I! Agent Config: Interval:10s, Quiet:false, Hostname:"4d2d0ab3fc73", Flush Interval:5s 
2018-08-02T15:19:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:20:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:20:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:20:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:20:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=61; discarding points
2018-08-02T15:20:35Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type string, already exists as type integer dropped=1; discarding points
2018-08-02T15:20:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:20:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=61; discarding points
2018-08-02T15:20:55Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-interfaces" is type string, already exists as type integer dropped=1; discarding points
2018-08-02T15:21:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:21:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:21:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:21:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:21:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=62; discarding points
2018-08-02T15:21:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:22:50Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:23:00Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:23:10Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:23:20Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:23:30Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points
2018-08-02T15:23:40Z E! [outputs.influxdb]: when writing to [http://172.17.0.2:8086]: received error partial write: field type conflict: input field "/components/component/properties/property/state/value" on measurement "oc-components" is type string, already exists as type integer dropped=31; discarding points

Looks like I got it here ok.
metrics.txt

Could you please remove on router from servers ? Stop everything and start again ?

Regards

routers removed from config, make stop/start

Are you still seeing those errors in the log ?

There were no errors while the routers were out of the config. I did a make stop, added them back in, make start, and the errors are back.

servers = [
"router-a:50051"
]

restarted only the input_oc container, still happening
make stop/start, still happening

I'm not sure if we have tried this before, but it could be possible to follow those steps ?

1) Stop input-oc container and remove it (example)

root@ubuntu:~/open-nti# docker ps
CONTAINER ID        IMAGE                                  COMMAND                  CREATED             STATUS                  PORTS                                                                                                                NAMES
[.....]                                                                                           chronograf_con
1dbc113bd770        open-nti_input-oc                      "/entrypoint.sh /sou…"   24 minutes ago      Up 24 minutes       8092/udp, 8125/udp,     8094/tcp, 0.0.0.0:50051->50051/udp                                                               opennti_input_oc
[.....]

docker stop 1dbc113bd770
docker rm 1dbc113bd770

2) Remove all measurements from influxdb (example)

root@d50552c870f4:/# influx
Connected to http://localhost:8086 version 1.5.1
InfluxDB shell version: 1.5.1
> use juniper
Using database juniper
> show MEASUREMENTS
name: measurements
name
----
junos-linecard-packet
oc-components
oc-interfaces

> DROP MEASUREMENT oc-components
> DROP MEASUREMENT oc-interfaces
> DROP MEASUREMENT junos-linecard-packet

... all measurements 

3) make stop 
4) make build-oc 
5) make start 

Regards

Pablo

I had been using make stop/start for most of this so that would have dropped everything from the db.

Any updates on this?

No yet, I'll try to get your JUNOS version and give it a try. I'm gonna be out a couple of weeks though.
Another test you can do is adding sensors one by one in the telegraf config file and see what happens in each iteration.

Could you please modify telegraf file configure only one sensor and see what happens ? (Removing beforehand all data from influxdb and doing stop/start)

sensors = [
"oc-components /components/",
]

Regards

The discarding points is not occurring anymore. Not sure why it stopped, but I no longer see it.

you mean not receiving that message (" "already exists as type integer dropped=62; discarding points"") with your original configuration anymore ?