Human Generated Data

Title

Untitled (men and women gathered around desk)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20246

Human Generated Data

Title

Untitled (men and women gathered around desk)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20246

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99.5
Human 99.5
Person 99.3
Person 98.8
Person 98.7
Person 98.5
Wheel 97.6
Machine 97.6
Tie 96.7
Accessories 96.7
Accessory 96.7
Clothing 95
Apparel 95
Person 94.5
Person 94.4
Face 91.2
Tie 90.9
Musician 90.3
Musical Instrument 90.3
Person 90.3
Sunglasses 84.5
Suit 84
Coat 84
Overcoat 84
Person 82
Music Band 78.8
Crowd 78.3
Smile 76.3
Dress 73.3
Room 69.6
Indoors 69.6
Portrait 69.2
Photography 69.2
Photo 69.2
People 66.6
Outdoors 66.1
Gong 63.6
Female 62.5
Leisure Activities 62
Tire 61.3
Performer 59.1
Nature 59
Brass Section 58.9
Ice 57.7
Horn 56

Clarifai
created on 2023-10-23

people 99.9
group 99.6
adult 98.9
woman 98.6
man 98.6
group together 98.2
child 95
many 93.8
veil 92.2
monochrome 92.1
drum 90.2
drummer 90.1
actor 89.7
several 89.7
leader 89.5
musician 88.4
wear 87.1
music 86
outfit 84.1
facial expression 80.2

Imagga
created on 2022-03-05

groom 39.1
man 37.6
male 35.4
people 35.1
couple 34
teacher 32.2
adult 31.5
bride 29.7
professional 29.3
person 26.2
happy 25.7
wedding 24.8
businessman 23.8
educator 23.3
men 23.2
happiness 21.9
nurse 21.5
love 21.3
business 20.6
dress 19.9
smiling 19.5
married 19.2
two 18.6
worker 17.9
life 17.6
together 17.5
group 16.9
women 16.6
bouquet 16.2
office 16.1
room 15.9
businesswoman 15.4
businesspeople 15.2
family 15.1
job 15
smile 15
portrait 14.9
corporate 14.6
romantic 14.2
marriage 14.2
meeting 14.1
day 14.1
executive 13.9
celebration 13.5
suit 13.5
flowers 13
colleagues 12.6
team 12.5
lifestyle 12.3
teamwork 12
sitting 12
kin 11.6
ceremony 11.6
romance 11.6
holding 11.5
table 11.2
work 11
associates 10.8
gown 10.7
working 10.6
cheerful 10.6
indoors 10.5
modern 10.5
human 10.5
husband 10.5
wife 10.4
mature 10.2
wind instrument 10.1
patient 10
brass 10
attractive 9.8
new 9.7
medical 9.7
outdoors 9.7
talking 9.5
musical instrument 9.4
successful 9.1
employee 8.9
success 8.8
coworkers 8.8
wed 8.8
veil 8.8
40s 8.8
brunette 8.7
mid adult 8.7
loving 8.6
adults 8.5
desk 8.5
flower 8.5
pretty 8.4
elegance 8.4
indoor 8.2
handsome 8
hospital 8
home 8
wedded 7.9
color 7.8
barbershop 7.8
30s 7.7
four 7.7
boss 7.6
communication 7.6
doctor 7.5
senior 7.5
clothes 7.5
traditional 7.5
spectator 7.5
manager 7.4
waiter 7.3
face 7.1

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

window 99
person 97.1
clothing 90.3
posing 86.4
man 84.9
sport 65.5
group 64.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Happy 61.6%
Calm 13.3%
Surprised 10%
Confused 4.8%
Angry 4%
Disgusted 2.5%
Sad 2.5%
Fear 1.2%

AWS Rekognition

Age 35-43
Gender Male, 73.1%
Sad 61.1%
Happy 12%
Calm 11.2%
Surprised 5.4%
Disgusted 4.3%
Fear 3.9%
Confused 1.3%
Angry 0.8%

AWS Rekognition

Age 42-50
Gender Male, 99.2%
Calm 61%
Happy 21.9%
Confused 6.8%
Surprised 4.8%
Disgusted 4.3%
Angry 0.6%
Fear 0.3%
Sad 0.3%

AWS Rekognition

Age 35-43
Gender Female, 79.4%
Happy 84.9%
Calm 8.3%
Surprised 4.2%
Sad 1%
Fear 0.5%
Angry 0.4%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 24-34
Gender Male, 76%
Calm 92.8%
Happy 3.4%
Sad 2.5%
Confused 0.5%
Disgusted 0.2%
Surprised 0.2%
Fear 0.2%
Angry 0.2%

AWS Rekognition

Age 30-40
Gender Female, 93.8%
Calm 63.7%
Happy 20.4%
Surprised 4.9%
Angry 3.1%
Disgusted 3%
Sad 2.7%
Confused 1.7%
Fear 0.6%

AWS Rekognition

Age 37-45
Gender Female, 93.4%
Happy 99%
Surprised 0.3%
Calm 0.2%
Disgusted 0.2%
Sad 0.1%
Confused 0.1%
Angry 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Wheel
Tie
Sunglasses
Person 99.5%
Person 99.3%
Person 98.8%
Person 98.7%
Person 98.5%
Person 94.5%
Person 94.4%
Person 90.3%
Person 82%
Wheel 97.6%
Tie 96.7%
Tie 90.9%
Sunglasses 84.5%

Text analysis

Amazon

Y