Human Generated Data

Title

Untitled (people sitting at cocktail party)

Date

c. 1950

People

Artist: Unidentified Artist,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19766

Human Generated Data

Title

Untitled (people sitting at cocktail party)

People

Artist: Unidentified Artist,

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19766

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99
Human 99
Person 99
Person 98.1
Tie 97.6
Accessories 97.6
Accessory 97.6
Person 97.4
Chair 96.8
Furniture 96.8
Chair 94.9
Person 94.9
Person 94.6
Person 89.8
Person 85.1
Person 79.5
Clothing 78.5
Apparel 78.5
Table 78.2
People 77.1
Sitting 76.8
Female 63.6
Photography 63
Photo 63
Portrait 61.8
Face 61.8
Person 61.1
Crowd 60.6
Dining Table 56

Clarifai
created on 2023-10-22

people 99.9
group 99.1
adult 98.4
woman 97.8
group together 97.7
many 97.3
man 96.9
education 95.7
uniform 91.9
teacher 89.3
school 87.9
child 87.6
wear 87
leader 84.6
indoors 84.4
several 84.1
medical practitioner 83.8
furniture 79.3
chair 78.2
monochrome 77.7

Imagga
created on 2022-03-05

nurse 58.3
man 44.4
person 40.1
male 38.3
people 36.8
adult 31.3
room 26
men 25.8
teacher 24.4
professional 24.1
businessman 23.8
business 23.1
office 21.7
smiling 20.3
happy 20
sitting 19.8
life 19.4
indoors 18.4
table 18.3
worker 18.1
desk 18.1
home 16.7
mature 16.7
women 16.6
work 16.6
colleagues 16.5
classroom 16.2
patient 16.1
meeting 16
senior 15.9
working 15.9
businesspeople 15.2
team 14.3
smile 14.3
couple 13.9
cheerful 13.8
group 13.7
businesswoman 13.6
happiness 13.3
talking 13.3
job 13.3
student 13.1
lifestyle 13
indoor 12.8
medical 12.4
together 12.3
educator 12.2
education 12.1
executive 11.8
portrait 11.6
hospital 11.4
corporate 11.2
teamwork 11.1
casual 11
20s 11
laptop 10.9
interior 10.6
blackboard 10.6
computer 10.4
suit 9.9
handsome 9.8
family 9.8
new 9.7
class 9.6
chair 9.6
two 9.3
clinic 9.2
modern 9.1
school 9.1
holding 9.1
board 9
health 9
associates 8.8
discussing 8.8
40s 8.8
30s 8.7
manager 8.4
occupation 8.2
looking 8
casual clothing 7.8
discussion 7.8
retirement 7.7
old 7.7
elderly 7.7
communication 7.6
doctor 7.5
care 7.4
inside 7.4
lady 7.3
color 7.2
case 7.1
musical instrument 7.1
document 7
brass 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

person 99
table 94.5
text 93.5
furniture 92.2
clothing 87.8
man 63.1
old 53.7

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 19-27
Gender Male, 99.5%
Happy 82.4%
Calm 7.9%
Surprised 4.1%
Sad 1.9%
Confused 1.7%
Disgusted 1%
Angry 0.7%
Fear 0.3%

AWS Rekognition

Age 38-46
Gender Female, 98.8%
Happy 92.5%
Surprised 5%
Sad 0.9%
Calm 0.5%
Confused 0.5%
Disgusted 0.3%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 29-39
Gender Male, 56.3%
Calm 84.1%
Sad 13.2%
Fear 0.6%
Disgusted 0.5%
Happy 0.5%
Confused 0.4%
Angry 0.3%
Surprised 0.3%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 99.8%
Sad 0.1%
Disgusted 0%
Confused 0%
Angry 0%
Happy 0%
Surprised 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Chair
Person 99%
Person 99%
Person 98.1%
Person 97.4%
Person 94.9%
Person 94.6%
Person 89.8%
Person 85.1%
Person 79.5%
Person 61.1%
Tie 97.6%
Chair 96.8%
Chair 94.9%

Text analysis

Amazon

80
8
a
3
st
st 3 a 8 "
"
KODAK-SVEELA

Google

t 3 a 8 YT37A2-XA
t
3
a
8
YT37A2-XA