Human Generated Data

Title

Untitled (Paine family album, including scenes from Kioto and Lake Chusenj and group portraits of Paine family and friends)
Date

c. 1880
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Janet and Daniel Tassel, 2007.219.15

Human Generated Data

Title

Untitled (Paine family album, including scenes from Kioto and Lake Chusenj and group portraits of Paine family and friends)

People

Artist: Unidentified Artist,

Date

c. 1880

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-05

Person 97.1
Human 97.1
Person 97
Person 95.7
Person 95
Person 94.7
Person 92.6
Gazebo 92
Person 88.2
Person 87.7
Person 82.6
Person 73
Person 68
Person 61.6
Person 44.7
Person 44.5

Clarifai
created on 2019-11-05

people 99.8
group 99.1
many 98.7
group together 98.3
adult 97
home 97
man 95.7
military 92.8
chair 90.1
administration 89.9
crowd 89.6
leader 88.4
soldier 87.9
no person 86
print 85.1
war 84.1
tree 83.5
cavalry 77.8
woman 77.1
several 77

Imagga
created on 2019-11-05

travel 35.2
structure 34.6
architecture 34.4
building 33.7
resort 32.1
sky 29.5
house 26.7
tourism 24.8
beach 22.3
patio 21.6
vacation 20.5
city 20
tropical 18.8
destination 18.7
area 18.2
tree 18
tourist 17.4
religion 17
history 17
palace 16.8
water 16.7
exterior 16.6
holiday 16.5
sea 16.4
carousel 15.9
landscape 15.6
sand 15.4
culture 15.4
trees 15.1
ocean 15
park 14.9
summer 14.8
temple 14.6
old 14.6
outdoor 14.5
ancient 13.8
snow 13.4
outdoors 13.2
sun 12.9
island 12.8
coast 12.6
ride 12.5
roof 12.4
landmark 11.7
buildings 11.4
historical 11.3
china 11.3
palm 11.2
home 11.2
traditional 10.8
stone 10.3
construction 10.3
mechanical device 10.2
clouds 10.2
peaceful 10.1
fence 10.1
university 10
school 9.9
river 9.8
new 9.7
scenic 9.7
hotel 9.6
paradise 9.4
place 9.3
famous 9.3
street 9.2
tower 9
picket fence 8.8
brick 8.7
day 8.6
sunny 8.6
england 8.6
outside 8.6
garden 8.5
winter 8.5
bay 8.5
relaxation 8.4
town 8.4
church 8.3
shore 8.2
wooden 7.9
grass 7.9
urban 7.9
scene 7.8
capital 7.6
relax 7.6
religious 7.5
east 7.5
weather 7.4
historic 7.3
umbrella 7.3

Google
created on 2019-11-05

Photograph 94.8
Snapshot 82.9
Tree 68.7
Photography 62.4
Black-and-white 56.4
Visual arts 55
Park 54.1
Art 50.2

Microsoft
created on 2019-11-05

outdoor 97.4
text 90.8
tree 90.6
sky 69.6
white 65
bicycle 54.5
old 50.6
drawn 50.5
several 10.6

Face analysis

Amazon

AWS Rekognition

Age 31-47
Gender Male, 50%
Fear 49.6%
Surprised 49.8%
Happy 49.6%
Confused 49.5%
Calm 49.9%
Sad 49.6%
Angry 49.5%
Disgusted 49.5%

AWS Rekognition

Age 39-57
Gender Male, 50.4%
Angry 49.6%
Confused 49.5%
Calm 49.7%
Disgusted 50.2%
Happy 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.4%
Calm 49.9%
Sad 49.6%
Confused 49.5%
Angry 49.6%
Surprised 49.5%
Fear 49.6%
Happy 49.6%
Disgusted 49.6%

AWS Rekognition

Age 35-51
Gender Male, 50.4%
Fear 49.5%
Angry 49.5%
Calm 49.7%
Happy 49.5%
Confused 49.5%
Disgusted 49.5%
Sad 50.3%
Surprised 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.1%
Surprised 49.6%
Confused 50.2%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%
Sad 49.5%
Fear 49.6%

AWS Rekognition

Age 32-48
Gender Male, 50.2%
Calm 50%
Angry 49.5%
Disgusted 49.5%
Sad 49.5%
Surprised 49.6%
Fear 49.6%
Confused 49.5%
Happy 49.8%

AWS Rekognition

Age 51-69
Gender Male, 50.4%
Surprised 49.5%
Sad 49.6%
Angry 49.5%
Calm 50.2%
Fear 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.7%

AWS Rekognition

Age 42-60
Gender Male, 50.4%
Calm 49.5%
Sad 49.5%
Disgusted 49.5%
Happy 49.5%
Fear 49.6%
Confused 49.5%
Angry 50.2%
Surprised 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.4%
Happy 49.6%
Calm 49.7%
Disgusted 49.6%
Confused 49.6%
Fear 49.5%
Surprised 49.5%
Sad 49.9%
Angry 49.5%

AWS Rekognition

Age 6-16
Gender Male, 50.3%
Confused 49.5%
Happy 49.5%
Sad 49.5%
Fear 49.5%
Calm 50.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 30-46
Gender Female, 50.2%
Disgusted 50.1%
Fear 49.5%
Confused 49.5%
Calm 49.6%
Angry 49.7%
Surprised 49.5%
Happy 49.5%
Sad 49.5%

AWS Rekognition

Age 26-40
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.6%
Angry 49.5%
Fear 49.5%
Confused 49.8%
Sad 50.1%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 23-35
Gender Male, 50.3%
Fear 49.7%
Angry 50.1%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Sad 49.5%

AWS Rekognition

Age 16-28
Gender Male, 50.1%
Calm 49.6%
Angry 49.5%
Disgusted 49.5%
Sad 49.5%
Surprised 50%
Fear 49.5%
Confused 49.8%
Happy 49.5%

Feature analysis

Amazon

Person 97.1%

Captions

Microsoft

a close up of a horse drawn carriage in front of a building 75%
a horse drawn carriage in front of a building 74.9%
a close up of a horse drawn carriage in front of a white building 60.9%

Text analysis

Amazon

17/7