Human Generated Data

Title

Untitled (audience watching Ed McQuille swing orchestra, 1937)
Date

1937, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5798

Human Generated Data

Title

Untitled (audience watching Ed McQuille swing orchestra, 1937)

People

Artist: Durette Studio, American 20th century

Date

1937, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5798

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Pub 98.6
Restaurant 98.2
Bar Counter 97.9
Human 87.4
Person 87.4
Person 85.8
Person 84.2
Cafe 81
Clothing 77.4
Apparel 77.4
Helmet 77.4
Cafeteria 76.1
Person 75.4
Food 68.9
Cake 68.9
Wedding Cake 68.9
Dessert 68.9
Person 68.6
Meal 58.1
Food Court 57.2
Beverage 56.8
Drink 56.8
Alcohol 56.8
Crowd 55.1
Shop 55

Clarifai
created on 2019-11-16

people 99.9
many 99
group together 98.5
adult 97.6
group 97.1
man 96.2
crowd 95.9
audience 95.8
indoors 93.4
furniture 93.3
woman 92.7
room 92.3
administration 90
monochrome 89.5
chair 89.1
spectator 88.6
wear 86.1
leader 85.7
seat 85
stump 81.2

Imagga
created on 2019-11-16

shop 26.3
crowd 25.9
room 25.2
people 24.5
silhouette 24
business 21.2
classroom 20.3
mercantile establishment 20.3
design 18.6
businessman 18.5
man 18.4
male 17
team 17
symbol 16.8
audience 16.6
city 15.8
lights 15.7
teamwork 15.7
occupation 15.6
person 15.3
patriotic 15.3
work 14.9
window 14.6
businesswoman 14.5
boss 14.3
flag 14.3
nation 14.2
job 14.1
presentation 13.9
supporters 13.8
president 13.7
cheering 13.7
nighttime 13.7
speech 13.7
place of business 13.7
stadium 13.6
building 13.6
leader 13.5
bright 12.9
travel 12.7
icon 12.7
toyshop 12.5
architecture 12.5
barbershop 12.4
vibrant 12.2
urban 12.2
light 12
black 12
transportation 11.6
sexy 11.2
vivid 11.1
night 10.6
group 10.5
old 10.4
meeting 10.4
transport 10
glass 9.7
couple 9.6
men 9.4
world 9.3
table 9
interior 8.8
center 8.7
station 8.7
scene 8.6
motion 8.6
stall 8.5
structure 8.4
chair 8
women 7.9
love 7.9
party 7.7
walking 7.6
relationship 7.5
art 7.3
religion 7.2
modern 7

Google
created on 2019-11-16

Photograph 96.8
Black-and-white 91.5
Snapshot 86.8
Monochrome 84.9
Crowd 76.4
Monochrome photography 76.2
Photography 74.8
Room 74.4
Stock photography 66.6
Style 51
Art 50.2

Microsoft
created on 2019-11-16

text 97.5
person 93.4
indoor 92.6
black and white 69.3
dance 62.7
clothing 60
restaurant 37.7
shop 9.5

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 23-35
Gender Male, 50.4%
Angry 49.5%
Happy 49.8%
Disgusted 49.5%
Sad 49.7%
Calm 49.7%
Surprised 49.5%
Confused 49.6%
Fear 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.1%
Disgusted 49.6%
Surprised 49.6%
Happy 49.5%
Confused 49.5%
Sad 49.6%
Fear 49.6%
Angry 49.6%
Calm 49.9%

AWS Rekognition

Age 32-48
Gender Male, 50.1%
Angry 49.5%
Fear 50%
Calm 49.5%
Sad 49.8%
Disgusted 49.5%
Happy 49.5%
Confused 49.5%
Surprised 49.5%

AWS Rekognition

Age 13-23
Gender Male, 50.4%
Calm 49.8%
Sad 50.1%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Angry 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.4%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.4%
Fear 49.5%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 23-37
Gender Female, 50.2%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Confused 49.5%
Fear 49.5%
Calm 50.1%
Sad 49.8%
Happy 49.5%

AWS Rekognition

Age 47-65
Gender Male, 50.4%
Confused 49.5%
Surprised 49.7%
Disgusted 49.5%
Happy 49.5%
Calm 50.1%
Sad 49.6%
Fear 49.6%
Angry 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.2%
Calm 49.7%
Happy 49.6%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Sad 50.1%
Confused 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.3%
Disgusted 49.6%
Happy 49.5%
Angry 49.5%
Fear 49.6%
Calm 49.6%
Confused 50%
Surprised 49.7%
Sad 49.5%

AWS Rekognition

Age 30-46
Gender Male, 50%
Disgusted 49.5%
Angry 49.5%
Calm 49.7%
Surprised 49.6%
Sad 49.7%
Confused 49.8%
Fear 49.7%
Happy 49.5%

AWS Rekognition

Age 20-32
Gender Female, 50.4%
Happy 49.5%
Disgusted 49.5%
Angry 49.5%
Fear 49.5%
Calm 50.3%
Surprised 49.5%
Sad 49.6%
Confused 49.5%

AWS Rekognition

Age 18-30
Gender Male, 50.1%
Surprised 49.5%
Angry 49.5%
Happy 49.5%
Fear 49.5%
Calm 49.7%
Disgusted 49.6%
Sad 50.1%
Confused 49.5%

AWS Rekognition

Age 13-25
Gender Female, 50.4%
Fear 49.6%
Sad 49.8%
Surprised 49.6%
Angry 49.5%
Disgusted 49.5%
Confused 49.5%
Happy 49.5%
Calm 49.9%

AWS Rekognition

Age 36-52
Gender Male, 50%
Disgusted 50.2%
Surprised 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.7%
Fear 49.6%
Angry 49.5%
Calm 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.3%
Calm 49.6%
Angry 49.5%
Fear 50%
Happy 49.6%
Sad 49.6%
Confused 49.5%
Disgusted 49.6%
Surprised 49.6%

AWS Rekognition

Age 36-52
Gender Male, 50.4%
Disgusted 49.5%
Happy 49.6%
Angry 49.5%
Fear 49.8%
Calm 49.7%
Confused 49.5%
Surprised 49.7%
Sad 49.6%

AWS Rekognition

Age 16-28
Gender Male, 50.1%
Fear 49.6%
Happy 49.5%
Angry 49.5%
Disgusted 50.1%
Sad 49.6%
Surprised 49.6%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 36-52
Gender Male, 50.5%
Fear 49.6%
Disgusted 49.5%
Calm 49.7%
Happy 49.5%
Surprised 49.6%
Angry 49.5%
Sad 50%
Confused 49.6%

AWS Rekognition

Age 27-43
Gender Male, 50.5%
Fear 49.5%
Surprised 49.5%
Angry 49.9%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Sad 49.7%
Calm 49.8%

AWS Rekognition

Age 21-33
Gender Male, 50.1%
Surprised 49.5%
Happy 49.5%
Sad 49.6%
Fear 49.5%
Calm 50.2%
Confused 49.5%
Disgusted 49.5%
Angry 49.5%

AWS Rekognition

Age 16-28
Gender Male, 50.4%
Sad 49.8%
Calm 50%
Angry 49.5%
Fear 49.6%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Confused 49.5%

AWS Rekognition

Age 37-55
Gender Male, 50.3%
Angry 49.5%
Disgusted 49.5%
Happy 49.5%
Calm 49.5%
Sad 49.8%
Surprised 49.5%
Fear 50.2%
Confused 49.5%

AWS Rekognition

Age 9-19
Gender Female, 50.1%
Disgusted 49.6%
Angry 49.7%
Confused 49.5%
Sad 49.9%
Calm 49.6%
Happy 49.6%
Fear 49.6%
Surprised 49.5%

AWS Rekognition

Age 6-16
Gender Male, 50.4%
Sad 49.7%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%
Happy 49.7%
Fear 49.8%
Angry 49.5%
Calm 49.8%

AWS Rekognition

Age 12-22
Gender Female, 50%
Calm 49.5%
Angry 50.4%
Surprised 49.5%
Disgusted 49.5%
Happy 49.5%
Sad 49.5%
Fear 49.6%
Confused 49.5%

AWS Rekognition

Age 16-28
Gender Male, 50%
Happy 49.5%
Confused 49.5%
Calm 49.5%
Fear 49.5%
Angry 49.7%
Sad 49.6%
Surprised 49.5%
Disgusted 50.1%

AWS Rekognition

Age 14-26
Gender Male, 50.3%
Disgusted 50%
Angry 49.5%
Calm 49.7%
Surprised 49.5%
Sad 49.7%
Confused 49.6%
Fear 49.5%
Happy 49.5%

AWS Rekognition

Age 11-21
Gender Male, 50.2%
Fear 50.2%
Confused 49.5%
Happy 49.5%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.6%
Sad 49.5%

AWS Rekognition

Age 25-39
Gender Male, 50.4%
Disgusted 49.5%
Angry 50.4%
Fear 49.5%
Happy 49.5%
Confused 49.5%
Sad 49.5%
Calm 49.5%
Surprised 49.5%

AWS Rekognition

Age 17-29
Gender Male, 50.4%
Happy 49.5%
Calm 50.4%
Fear 49.5%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 49.6%

AWS Rekognition

Age 28-44
Gender Female, 50%
Confused 49.5%
Fear 49.6%
Sad 49.7%
Disgusted 49.6%
Happy 49.5%
Angry 49.6%
Calm 50%
Surprised 49.5%

AWS Rekognition

Age 15-27
Gender Male, 50.3%
Calm 49.6%
Angry 49.5%
Fear 49.7%
Happy 49.5%
Sad 49.5%
Confused 49.6%
Disgusted 49.6%
Surprised 49.9%

AWS Rekognition

Age 20-32
Gender Male, 50.4%
Disgusted 49.5%
Confused 49.5%
Angry 49.7%
Happy 49.5%
Sad 49.8%
Calm 49.8%
Surprised 49.5%
Fear 49.7%

AWS Rekognition

Age 22-34
Gender Male, 50.3%
Surprised 49.6%
Sad 49.6%
Fear 49.8%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 49.7%
Calm 49.6%

AWS Rekognition

Age 32-48
Gender Male, 50.3%
Calm 49.5%
Angry 49.5%
Disgusted 49.6%
Happy 49.5%
Sad 49.8%
Confused 49.9%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 34-50
Gender Male, 50.3%
Happy 49.6%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Sad 50.2%
Fear 49.6%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 25-39
Gender Female, 50.4%
Angry 49.5%
Surprised 49.5%
Sad 49.5%
Happy 49.5%
Calm 50.5%
Fear 49.5%
Confused 49.5%
Disgusted 49.5%

AWS Rekognition

Age 23-35
Gender Male, 50.5%
Sad 49.5%
Disgusted 49.5%
Confused 49.6%
Surprised 50.1%
Happy 49.5%
Fear 49.6%
Angry 49.5%
Calm 49.6%

AWS Rekognition

Age 23-37
Gender Female, 50.2%
Happy 49.5%
Sad 49.9%
Disgusted 49.5%
Surprised 49.5%
Fear 49.5%
Angry 49.7%
Confused 49.5%
Calm 49.8%

AWS Rekognition

Age 32-48
Gender Male, 50.3%
Disgusted 49.5%
Angry 49.5%
Confused 49.5%
Sad 50.3%
Calm 49.6%
Happy 49.5%
Fear 49.5%
Surprised 49.5%

AWS Rekognition

Age 26-42
Gender Female, 50%
Angry 50.1%
Sad 49.8%
Confused 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.5%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 31-47
Gender Female, 50.1%
Calm 49.8%
Disgusted 49.6%
Happy 49.5%
Fear 49.6%
Confused 49.7%
Angry 49.6%
Surprised 49.6%
Sad 49.7%

AWS Rekognition

Age 33-49
Gender Male, 50.2%
Angry 49.8%
Calm 49.6%
Sad 50%
Happy 49.5%
Fear 49.6%
Confused 49.5%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 12-22
Gender Male, 50.5%
Sad 49.9%
Angry 49.5%
Calm 49.8%
Happy 49.7%
Surprised 49.5%
Confused 49.5%
Disgusted 49.5%
Fear 49.5%

AWS Rekognition

Age 24-38
Gender Male, 50.1%
Angry 49.6%
Fear 49.7%
Confused 49.5%
Calm 49.7%
Sad 49.7%
Disgusted 49.6%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 17-29
Gender Female, 50.2%
Surprised 49.5%
Angry 49.5%
Sad 49.6%
Fear 49.5%
Disgusted 50.1%
Happy 49.5%
Calm 49.6%
Confused 49.5%

AWS Rekognition

Age 14-26
Gender Male, 50.4%
Happy 49.5%
Angry 49.5%
Disgusted 49.6%
Surprised 49.5%
Sad 50.1%
Fear 49.7%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 28-44
Gender Male, 50.3%
Happy 49.5%
Confused 49.5%
Calm 49.6%
Fear 49.5%
Angry 49.5%
Sad 50.3%
Surprised 49.5%
Disgusted 49.5%

AWS Rekognition

Age 6-16
Gender Male, 50.5%
Confused 49.6%
Happy 49.5%
Fear 49.5%
Sad 49.7%
Surprised 49.5%
Angry 49.6%
Disgusted 49.5%
Calm 50.1%

AWS Rekognition

Age 7-17
Gender Female, 50.1%
Fear 50.2%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Calm 49.6%
Sad 49.7%
Surprised 49.5%

AWS Rekognition

Age 8-18
Gender Female, 50.3%
Happy 49.6%
Disgusted 49.8%
Calm 49.6%
Sad 49.6%
Surprised 49.5%
Confused 49.6%
Fear 49.6%
Angry 49.7%

AWS Rekognition

Age 19-31
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.7%
Fear 49.6%
Calm 49.8%
Angry 49.7%
Confused 49.5%
Sad 49.6%
Surprised 49.5%

AWS Rekognition

Age 27-43
Gender Male, 50.5%
Surprised 49.5%
Sad 49.6%
Fear 49.5%
Angry 49.6%
Happy 49.5%
Disgusted 49.5%
Confused 50.1%
Calm 49.5%

AWS Rekognition

Age 20-32
Gender Male, 50.4%
Fear 49.5%
Confused 49.5%
Calm 50.1%
Sad 49.5%
Disgusted 49.6%
Happy 49.5%
Surprised 49.5%
Angry 49.7%

AWS Rekognition

Age 30-46
Gender Female, 50.1%
Fear 49.5%
Sad 50.4%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%

AWS Rekognition

Age 21-33
Gender Female, 50.2%
Fear 49.5%
Calm 49.6%
Disgusted 49.6%
Happy 49.5%
Sad 49.8%
Confused 49.6%
Surprised 49.5%
Angry 49.8%

AWS Rekognition

Age 15-27
Gender Male, 50.5%
Sad 49.8%
Disgusted 49.6%
Confused 49.5%
Surprised 49.5%
Happy 49.5%
Fear 49.6%
Angry 49.8%
Calm 49.7%

AWS Rekognition

Age 20-32
Gender Female, 50.2%
Sad 49.5%
Angry 49.5%
Happy 49.6%
Calm 50.3%
Fear 49.5%
Disgusted 49.5%
Confused 49.5%
Surprised 49.5%

Feature analysis

Amazon

Person 87.4%
Helmet 77.4%
Wedding Cake 68.9%

Captions

Microsoft
created on 2019-11-16

a group of people in a restaurant 90.9%
a group of people in a room 90.8%
a group of people in a store 80.6%

Text analysis

Amazon

(9374
SWING!
79314 SWING! (9374
79314

Google

(931A SWING
(931A
SWING