Human Generated Data

Title

Untitled (man sitting in crowd being kissed on head by a standing woman)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15021

Human Generated Data

Title

Untitled (man sitting in crowd being kissed on head by a standing woman)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.9
Apparel 99.9
Human 99.1
Person 99.1
Person 99.1
Person 98
Person 95.6
Fashion 95.5
Robe 95.5
Wedding 94.4
Bridegroom 94.4
Gown 94
Person 93.9
Person 93.3
Wedding Gown 85.4
Bride 85.4
Face 84.1
Hat 83.5
Person 82.1
Female 77.4
Leisure Activities 68.4
Dance Pose 68.4
Suit 68.3
Coat 68.3
Overcoat 68.3
Sleeve 66.5
Portrait 65.7
Photography 65.7
Photo 65.7
Dance 65.5
Person 62.8
Outdoors 60.8
Nature 60.7
Woman 59.9
Furniture 59.8
Chair 59.8
Person 58.4
Hug 58.1
Person 57.2
Girl 55.9
Person 48.4

Imagga
created on 2022-03-05

man 38.3
person 37.2
people 35.1
male 34
professional 32.3
businessman 28.2
office 27.4
adult 22.6
business 22.5
men 21.5
corporate 20.6
team 19.7
job 19.5
patient 18.6
group 18.5
working 17.7
work 17.3
worker 17.1
meeting 17
happy 16.9
medical 16.8
indoors 16.7
businesspeople 16.1
women 15.8
education 15.6
room 15.2
desk 15.1
teamwork 14.8
executive 14.7
sitting 14.6
businesswoman 14.5
smiling 14.5
doctor 14.1
indoor 13.7
looking 13.6
teacher 13.5
modern 13.3
clinic 13
occupation 12.8
computer 12.8
human 12.7
career 12.3
lifestyle 12.3
coat 12.2
couple 12.2
smile 12.1
nurse 12.1
colleagues 11.7
portrait 11.6
groom 11.5
hospital 11.5
medicine 11.4
manager 11.2
health 11.1
clothing 11
casual 11
two 11
suit 10.8
mid adult 10.6
film 10.5
technology 10.4
table 10.4
case 10.3
student 10.2
negative 10.2
communication 10.1
laptop 10
care 9.9
success 9.7
together 9.6
lab coat 9.3
instrument 9.2
holding 9.1
cheerful 8.9
chair 8.7
boss 8.6
talking 8.6
adults 8.5
inside 8.3
successful 8.2
sick person 8.2
employee 8
coworkers 7.9
lab 7.8
development 7.6
hand 7.6
study 7.5
bride 7.4
company 7.4
mature 7.4
life 7.4
back 7.3
classroom 7.3
confident 7.3
device 7.1
face 7.1
practitioner 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 97.3
drawing 86.6
person 86.5
black and white 76.6
clothing 74
sketch 69
wedding dress 58
human face 56.5
old 54.7
posing 50.3

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Female, 89.3%
Surprised 39.3%
Fear 25.1%
Happy 17.8%
Sad 9.8%
Confused 2.5%
Calm 2.2%
Disgusted 1.7%
Angry 1.5%

AWS Rekognition

Age 51-59
Gender Male, 89.3%
Happy 61.2%
Calm 33.3%
Surprised 2.8%
Confused 1.4%
Disgusted 0.5%
Angry 0.4%
Sad 0.3%
Fear 0.1%

AWS Rekognition

Age 48-54
Gender Male, 60%
Calm 68.2%
Sad 8.6%
Fear 7.4%
Happy 6.8%
Surprised 6.3%
Disgusted 1.4%
Confused 0.8%
Angry 0.4%

AWS Rekognition

Age 31-41
Gender Female, 89.7%
Calm 65.6%
Sad 15.2%
Happy 13.5%
Disgusted 1.3%
Confused 1.3%
Angry 1.2%
Fear 1%
Surprised 0.8%

AWS Rekognition

Age 9-17
Gender Female, 98.1%
Fear 49.8%
Calm 32.7%
Surprised 6.5%
Sad 5.6%
Disgusted 1.7%
Confused 1.6%
Angry 1.1%
Happy 1%

AWS Rekognition

Age 47-53
Gender Female, 73.4%
Sad 51.4%
Calm 39%
Confused 7.7%
Happy 0.8%
Angry 0.3%
Fear 0.3%
Disgusted 0.3%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Hat 83.5%

Captions

Microsoft

an old photo of a person 80.3%
an old photo of a man and woman posing for a picture 48.4%
an old photo of a person 48.3%