Human Generated Data

Title

Untitled (crowd watching band perform, trumpet player)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14286

Human Generated Data

Title

Untitled (crowd watching band perform, trumpet player)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.9
Apparel 99.9
Human 99.3
Person 99.3
Person 98.6
Person 98.5
Person 98.2
Person 97.8
Person 97.4
Person 95.9
Fashion 95.7
Robe 95.7
Gown 94
Wedding 91.4
Person 86.2
Wedding Gown 83.9
Bride 82.2
Person 82.1
Leisure Activities 76.8
Overcoat 75.4
Coat 75.4
Suit 75.4
Person 74.5
Long Sleeve 72.9
Sleeve 72.9
Female 67
Bridegroom 66.9
Musical Instrument 59.6
Evening Dress 56.4
Crowd 55.8
Brass Section 55.1

Imagga
created on 2022-01-29

people 31.8
man 28.2
male 27.6
business 25.5
person 24.6
group 23.4
businessman 21.2
men 16.3
team 16.1
work 15.7
adult 15.1
student 14.5
crowd 14.4
professional 13.5
women 13.4
stage 13.4
education 13
nurse 12.1
happy 11.9
technology 11.9
science 11.5
teamwork 11.1
lab coat 11
portrait 11
job 10.6
exam 10.5
human 10.5
world 10.4
doctor 10.3
corporate 10.3
coat 10.2
clothing 10
worker 9.9
blackboard 9.8
working 9.7
looking 9.6
smiling 9.4
classroom 9.4
face 9.2
occupation 9.2
silhouette 9.1
businesswoman 9.1
fun 9
medical 8.8
patient 8.7
case 8.5
school 8.2
together 7.9
design 7.9
couple 7.8
scientist 7.8
nightlife 7.8
building 7.8
black 7.8
scene 7.8
color 7.8
thoughtful 7.8
lab 7.8
laboratory 7.7
motion 7.7
health 7.6
life 7.6
casual 7.6
engineering 7.6
finance 7.6
hand 7.6
walking 7.6
city 7.5
art 7.5
globe 7.4
bar 7.4
camera 7.4
office 7.4
20s 7.3
music 7.2
teacher 7.2
activity 7.2
day 7.1
happiness 7
medicine 7
indoors 7
garment 7
modern 7

Google
created on 2022-01-29

Coat 88.7
Gesture 85.3
Art 83.4
Military person 80.2
Suit 78.7
Vintage clothing 72.9
Font 71.5
Event 71.2
Crew 67.9
Monochrome photography 67.3
Monochrome 67.1
Military officer 66.4
Hat 65.9
Uniform 65.7
Non-commissioned officer 65.6
Stock photography 64.9
History 64.5
Illustration 63.8
Team 61.6
Flag 59.3

Microsoft
created on 2022-01-29

text 99.1
clothing 92.3
person 92.2
man 80.2
woman 67.8
group 67.6
posing 36.9
clothes 18.6

Face analysis

Amazon

Google

AWS Rekognition

Age 28-38
Gender Male, 94.6%
Calm 81.7%
Sad 18%
Confused 0.1%
Angry 0.1%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 23-33
Gender Male, 93.6%
Calm 97.7%
Sad 1.4%
Confused 0.3%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 30-40
Gender Female, 74.5%
Calm 99.3%
Sad 0.3%
Surprised 0.2%
Disgusted 0.1%
Happy 0.1%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 28-38
Gender Male, 99.9%
Calm 82.5%
Sad 4.9%
Surprised 4.3%
Angry 2.6%
Disgusted 1.7%
Fear 1.5%
Confused 1.3%
Happy 1.2%

AWS Rekognition

Age 30-40
Gender Male, 99.9%
Calm 59.5%
Sad 11.8%
Confused 11.1%
Happy 6.5%
Surprised 4.3%
Disgusted 3.9%
Angry 1.8%
Fear 1.1%

AWS Rekognition

Age 30-40
Gender Male, 77.4%
Calm 99.9%
Surprised 0.1%
Sad 0%
Happy 0%
Disgusted 0%
Confused 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 29-39
Gender Male, 99.9%
Calm 99.2%
Confused 0.3%
Sad 0.2%
Happy 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 16-22
Gender Male, 92.5%
Calm 91.5%
Sad 4.6%
Confused 1.7%
Angry 0.9%
Happy 0.5%
Surprised 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 95.1%
Calm 98.3%
Surprised 0.9%
Sad 0.5%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 35-43
Gender Male, 97.3%
Calm 98.5%
Sad 0.6%
Happy 0.4%
Confused 0.3%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 24-34
Gender Female, 94.7%
Calm 70.9%
Happy 11.9%
Sad 10.9%
Surprised 2.6%
Angry 1.7%
Fear 0.9%
Disgusted 0.6%
Confused 0.5%

AWS Rekognition

Age 26-36
Gender Male, 88.9%
Sad 59.2%
Calm 9.9%
Angry 8.6%
Fear 8%
Confused 7.7%
Happy 2.8%
Disgusted 2.2%
Surprised 1.6%

AWS Rekognition

Age 30-40
Gender Male, 74.4%
Sad 81.7%
Calm 11.5%
Confused 4%
Fear 1.2%
Happy 0.6%
Disgusted 0.5%
Angry 0.3%
Surprised 0.1%

AWS Rekognition

Age 28-38
Gender Male, 88%
Sad 87.1%
Calm 4.9%
Fear 2.6%
Confused 1.9%
Angry 1.5%
Disgusted 0.8%
Happy 0.7%
Surprised 0.4%

AWS Rekognition

Age 27-37
Gender Male, 94.4%
Calm 98.4%
Sad 1.1%
Confused 0.2%
Angry 0.1%
Surprised 0.1%
Happy 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 27-37
Gender Male, 95%
Calm 99.7%
Happy 0.1%
Sad 0.1%
Surprised 0%
Fear 0%
Confused 0%
Disgusted 0%
Angry 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a window 84.5%
a group of people standing next to a window 84.4%
a group of people posing for a photo 81.9%

Text analysis

Amazon

MJI7
MJI7 YESTAD AROA
AROA
YESTAD

Google

MJ17
2
MJ17 YT37A 2 A73A
YT37A
A73A