Human Generated Data

Title

Untitled (large interior of banquet hall from side with guests at tables)

Date

1939

People

Artist: Durette Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4086

Human Generated Data

Title

Untitled (large interior of banquet hall from side with guests at tables)

People

Artist: Durette Studio, American 20th century

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-01

Building 99.4
Person 99.3
Human 99.3
Person 99.1
Factory 98.7
Person 98.4
Person 97.1
Person 95.6
Person 90
Person 89.3
Assembly Line 88.4
Person 87.9
Person 86.7
Person 82.2
Person 82
Hat 77
Apparel 77
Clothing 77
Person 63
People 62.6
Person 43.9

Clarifai
created on 2019-06-01

people 99.7
crowd 98.6
group together 97.7
group 97.1
many 96.6
man 96.5
adult 95.6
audience 93.3
woman 91.2
indoors 86.1
spectator 81.9
city 81.6
ceremony 81
music 80.1
leader 80.1
chair 79
room 78.6
administration 78
event 77
person 76.3

Imagga
created on 2019-06-01

hall 55.8
architecture 33.1
interior 31.8
business 30.4
city 29.4
office 29.2
building 28.6
urban 27.9
modern 25.9
floor 25.1
construction 20.5
tracing 20.4
glass 19.8
transportation 19.7
corridor 19.6
station 19
perspective 17.9
inside 17.5
window 16.6
design 15.2
drawing 15.2
plan 15.1
indoor 14.6
empty 14.6
light 14
structure 14
tunnel 13.7
way 13.5
sketch 13.4
motion 12.8
speed 12.8
hallway 12.8
walkway 12.7
blueprint 12.7
technology 12.6
architect 12.5
project 12.5
center 12.3
people 12.3
travel 12
transport 11.9
subway 11.8
boutique 11.8
reflection 11.8
mall 11.7
move 11.5
line 11.1
escalator 10.9
metro 10.8
futuristic 10.8
entrance 10.6
passage 10.6
roof 10.5
walk 10.5
metal 10.5
scene 10.4
industry 10.2
work 10.2
life 10.2
room 10.1
facility 9.9
stall 9.9
airport 9.8
public 9.7
train 9.7
indoors 9.7
wall 9.6
engineering 9.5
3d 9.3
finance 9.3
house 9.2
activity 9
idea 8.9
drafting 8.9
success 8.8
ceiling 8.8
growth 8.8
paper 8.8
built 8.7
corporate 8.6
traffic 8.5
walking 8.5
underground 7.9
vehicle 7.8
space 7.8
crowd 7.7
lights 7.4
development 7.2
financial 7.1

Google
created on 2019-06-01

Microsoft
created on 2019-06-01

wedding 98.4
outdoor 88.6
man 75.6
person 68.3
people 66
group 61.9
clothing 53.8
posing 39.6
crowd 38.3

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 69.3%
Angry 1.1%
Sad 1.6%
Disgusted 0.5%
Surprised 3%
Happy 90.1%
Calm 2.3%
Confused 1.4%

AWS Rekognition

Age 26-43
Gender Female, 78.4%
Confused 7.1%
Calm 48.3%
Sad 14.3%
Surprised 15.4%
Angry 5.8%
Disgusted 3.2%
Happy 5.9%

AWS Rekognition

Age 35-52
Gender Male, 53.7%
Disgusted 45.5%
Happy 45.3%
Surprised 46.1%
Sad 47%
Angry 47.6%
Confused 46.6%
Calm 46.9%

AWS Rekognition

Age 10-15
Gender Female, 54.3%
Angry 45.9%
Sad 51.5%
Disgusted 45.2%
Surprised 45.4%
Happy 45.1%
Calm 45.9%
Confused 45.9%

AWS Rekognition

Age 29-45
Gender Female, 76.3%
Surprised 7.4%
Confused 3.5%
Disgusted 0.9%
Happy 1.3%
Sad 34%
Calm 49.6%
Angry 3.3%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Disgusted 49.5%
Happy 49.6%
Surprised 49.5%
Sad 50.3%
Angry 49.5%
Confused 49.5%
Calm 49.6%

AWS Rekognition

Age 19-36
Gender Female, 78.2%
Angry 3.5%
Sad 3.9%
Happy 18.8%
Confused 2.5%
Surprised 12.6%
Calm 58.2%
Disgusted 0.6%

AWS Rekognition

Age 26-43
Gender Male, 53.4%
Disgusted 45.2%
Calm 51.1%
Surprised 45.4%
Angry 45.6%
Happy 45.8%
Sad 46.4%
Confused 45.4%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Confused 45.4%
Surprised 45.7%
Happy 45.8%
Angry 45.7%
Sad 49.3%
Disgusted 45.6%
Calm 47.5%

AWS Rekognition

Age 26-43
Gender Male, 54.6%
Happy 45.6%
Sad 45.3%
Confused 45.6%
Angry 45.4%
Disgusted 46%
Surprised 45.5%
Calm 51.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Happy 49.5%
Disgusted 49.5%
Sad 49.7%
Surprised 49.6%
Angry 49.6%
Calm 50%
Confused 49.6%

AWS Rekognition

Age 49-69
Gender Male, 53.3%
Angry 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 54.1%
Sad 45.1%
Surprised 45.2%
Happy 45.2%

AWS Rekognition

Age 26-43
Gender Male, 50.4%
Calm 49.5%
Surprised 49.5%
Disgusted 49.7%
Happy 49.5%
Sad 49.9%
Confused 49.7%
Angry 49.6%

AWS Rekognition

Age 26-43
Gender Female, 51.7%
Disgusted 45.4%
Calm 48.9%
Angry 45.6%
Sad 47%
Happy 45.2%
Surprised 45.8%
Confused 47.1%

AWS Rekognition

Age 26-43
Gender Male, 50.1%
Disgusted 49.6%
Happy 49.6%
Sad 49.9%
Calm 49.6%
Angry 49.7%
Surprised 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Calm 49.6%
Disgusted 49.6%
Confused 49.5%
Surprised 49.6%
Happy 49.7%
Sad 49.8%
Angry 49.7%

AWS Rekognition

Age 27-44
Gender Male, 54.5%
Disgusted 45%
Calm 54.2%
Surprised 45.1%
Angry 45.1%
Happy 45.1%
Sad 45.4%
Confused 45.1%

AWS Rekognition

Age 20-38
Gender Female, 50.2%
Angry 49.5%
Happy 49.5%
Confused 49.6%
Calm 50%
Surprised 49.6%
Sad 49.9%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.1%
Happy 49.5%
Confused 49.6%
Angry 49.6%
Sad 49.8%
Calm 49.8%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Confused 49.5%
Surprised 49.6%
Happy 49.7%
Angry 49.6%
Sad 49.7%
Disgusted 49.6%
Calm 49.8%

AWS Rekognition

Age 16-27
Gender Female, 52.9%
Angry 45.8%
Happy 45.4%
Confused 45.8%
Sad 51.2%
Calm 46.1%
Surprised 45.3%
Disgusted 45.4%

AWS Rekognition

Age 14-23
Gender Male, 50.4%
Happy 49.5%
Confused 49.5%
Angry 49.5%
Disgusted 50.3%
Surprised 49.5%
Sad 49.5%
Calm 49.6%

AWS Rekognition

Age 15-25
Gender Male, 50.5%
Disgusted 49.5%
Confused 49.7%
Sad 49.7%
Happy 49.5%
Angry 49.8%
Surprised 49.6%
Calm 49.7%

AWS Rekognition

Age 15-25
Gender Female, 50.2%
Sad 49.6%
Surprised 49.6%
Disgusted 49.6%
Angry 49.6%
Calm 49.7%
Happy 49.9%
Confused 49.6%

AWS Rekognition

Age 17-27
Gender Male, 51.6%
Happy 46%
Sad 48.7%
Confused 45.7%
Angry 46.9%
Disgusted 45.5%
Surprised 46%
Calm 46.1%

AWS Rekognition

Age 35-52
Gender Male, 52.4%
Angry 45.7%
Happy 46%
Confused 45.3%
Calm 50.4%
Surprised 45.9%
Sad 46.1%
Disgusted 45.6%

AWS Rekognition

Age 15-25
Gender Female, 50.4%
Happy 49.5%
Calm 49.8%
Angry 49.6%
Surprised 49.6%
Disgusted 49.5%
Confused 49.6%
Sad 49.8%

AWS Rekognition

Age 23-38
Gender Male, 50.4%
Sad 49.6%
Angry 49.6%
Disgusted 50.1%
Surprised 49.5%
Happy 49.6%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.4%
Happy 49.6%
Confused 49.6%
Disgusted 49.5%
Sad 50.1%
Calm 49.7%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 54.7%
Surprised 45.1%
Calm 54.2%
Disgusted 45.1%
Confused 45.1%
Sad 45.2%
Happy 45.2%
Angry 45.1%

AWS Rekognition

Age 16-27
Gender Female, 50.4%
Angry 49.5%
Sad 49.7%
Disgusted 49.5%
Happy 49.8%
Calm 49.8%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 35-52
Gender Female, 50.2%
Sad 49.8%
Angry 49.6%
Happy 49.6%
Confused 49.5%
Calm 49.8%
Surprised 49.5%
Disgusted 49.6%

Feature analysis

Amazon

Person 99.3%
Hat 77%

Captions

Microsoft

a group of people standing in front of a crowd posing for the camera 84.2%
a group of people standing in front of a crowd 84.1%
a group of people posing for a photo in front of a crowd 83.6%

Text analysis

Amazon

R