Human Generated Data

Title

Untitled (Northern Ireland)

Date

1984

People

Artist: Gilles Peress, French born 1946

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Schneider/Erdman Printer's Proof Collection, partial gift, and partial purchase through the Margaret Fisher Fund, 2011.394

Copyright

© Gilles Peress/Magnum Photos

Human Generated Data

Title

Untitled (Northern Ireland)

People

Artist: Gilles Peress, French born 1946

Date

1984

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-08

Human 98.2
Person 98.2
Person 97.8
Car 97.1
Transportation 97.1
Automobile 97.1
Vehicle 97.1
Person 96.5
Person 91.5
Face 89.3
Clothing 86
Apparel 86
Person 71.2
Train 70.9
Window 62.9
Overcoat 59.9
Coat 59.9
Chair 59.6
Furniture 59.6
Bus 58.3
Female 55.5
Girl 55.5

Clarifai
created on 2018-02-09

transportation system 99.9
vehicle 99.9
people 99.9
car 99.6
adult 99.1
woman 98.8
man 98.4
two 98.2
vehicle window 98.1
one 97.7
train 97.2
driver 96.6
administration 96.2
street 94.8
group 94.4
railway 92.9
portrait 92.9
leader 91.8
aircraft 91.3
group together 90.8

Imagga
created on 2018-02-09

mirror 100
car 85.7
reflector 70.8
vehicle 57
driver 49.6
transportation 46.7
automobile 44.1
sitting 37.8
driving 37.7
passenger 36.3
drive 36
auto 35.4
headrest 31.3
person 27.8
transport 27.4
happy 24.5
rest 24.4
people 24
adult 24
smiling 23.9
travel 23.3
wheel 22.7
smile 22.1
road 21.7
man 21.5
portrait 21.4
new 21.1
happiness 20.4
inside 20.3
window 20.2
support 19.8
seat 18.4
attractive 16.8
male 15.6
cheerful 15.5
outdoors 14.9
device 14.4
pretty 14
face 13.5
fun 13.5
speed 12.8
looking 12.8
hair 12.7
motor 12.6
traffic 12.4
safety 12
one 12
casual 11.9
business 11.5
hand 11.4
side 11.3
cute 10.8
fashion 10.6
joy 10
steering 9.9
trip 9.4
modern 9.1
holding 8.3
human 8.3
20s 8.3
reflection 8.1
family 8
women 7.9
black 7.8
model 7.8
traveling 7.8
insurance 7.7
sit 7.6
phone 7.4
teen 7.4
alone 7.3
summer 7.1
interior 7.1

Microsoft
created on 2018-02-09

car 99.5
person 97.6
man 91.9
bus 90.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-77
Gender Male, 98.3%
Happy 0.1%
Surprised 0.2%
Angry 0.5%
Confused 0.6%
Disgusted 0.4%
Calm 97.2%
Sad 1%

AWS Rekognition

Age 4-7
Gender Female, 72.8%
Confused 16.7%
Surprised 22.9%
Happy 2.3%
Angry 5.8%
Disgusted 6.3%
Sad 10.3%
Calm 35.6%

AWS Rekognition

Age 20-38
Gender Female, 83.1%
Surprised 0.4%
Disgusted 0.6%
Happy 0.6%
Sad 93.3%
Calm 3.9%
Angry 0.5%
Confused 0.6%

Microsoft Cognitive Services

Age 44
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%
Car 97.1%

Captions

Microsoft

a man sitting on a bus 76.7%
a man and a woman sitting on a bus 65.1%
a man sitting in a car 65%