Human Generated Data

Title

Untitled (people at party, man with accordion)

Date

1950

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20023

Human Generated Data

Title

Untitled (people at party, man with accordion)

People

Artist: Peter James Studio, American

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Accessory 98.6
Tie 98.6
Accessories 98.6
Person 98.3
Human 98.3
Tie 98
Person 97.8
Person 97.3
Person 95.7
Tie 95.4
Person 93.9
Musical Instrument 87.5
Accordion 82.7
Overcoat 78.2
Coat 78.2
Clothing 78.2
Apparel 78.2
Suit 78.2
Suit 76.8

Imagga
created on 2022-03-05

person 49.6
man 46.4
male 43.3
lab coat 38.9
coat 37.6
people 34
businessman 33.5
adult 33.3
professional 32.1
business 27.9
patient 26.4
doctor 26.3
medical 25.6
senior 24.4
work 24.3
job 23.9
looking 23.2
happy 22.6
team 22.4
mature 22.3
group 21.8
men 21.5
nurse 21.4
office 20.9
hospital 20
portrait 19.4
worker 18.9
meeting 18.8
health 18.8
elderly 18.2
smiling 18.1
colleagues 17.5
indoor 17.3
desk 17
handsome 16.9
teamwork 16.7
table 16.4
case 16.2
businesspeople 16.1
indoors 15.8
care 15.6
corporate 15.5
teacher 15.5
medicine 15
smile 15
executive 14.8
specialist 14.4
working 14.1
clinic 13.6
30s 13.5
technology 13.4
garment 13.1
standing 13
sitting 12.9
color 12.8
face 12.8
student 12.8
human 12.7
businesswoman 12.7
casual 12.7
two 12.7
clothing 12.5
cheerful 12.2
home 12
suit 11.9
occupation 11.9
happiness 11.8
stethoscope 11.7
uniform 11.6
lifestyle 11.6
staff 11.5
sick person 11.4
success 11.3
company 11.2
surgeon 11
20s 11
successful 11
associates 10.8
profession 10.5
modern 10.5
old 10.5
education 10.4
camera 10.2
coworkers 9.8
discussion 9.7
middle aged 9.7
cooperation 9.7
couple 9.6
serious 9.5
room 9.3
laptop 9.1
engineer 9
computer 8.8
clinical 8.8
40s 8.8
older 8.7
designer 8.7
mid adult 8.7
busy 8.7
entrepreneur 8.7
retirement 8.6
chart 8.6
bright 8.6
tie 8.5
plan 8.5
manager 8.4
horizontal 8.4
glasses 8.3
stage 8.2
confident 8.2
life 8.1
science 8
educator 7.9
building 7.9
women 7.9
together 7.9
explaining 7.9
discussing 7.9
day 7.8
50s 7.8
diagnosis 7.8
conference 7.8
black 7.8
lab 7.8
expertise 7.8
retired 7.8
writing 7.8
architect 7.7
project 7.7
equipment 7.7
pencil 7.6
hand 7.6
presentation 7.4
holding 7.4
light 7.4
friendly 7.3
new 7.3
practitioner 7.1
to 7.1
planner 7
classroom 7
look 7

Microsoft
created on 2022-03-05

wall 96.3
text 94.9
posing 81.3
black and white 74.5
old 40.9

Face analysis

Amazon

Google

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Happy 39.9%
Calm 35.6%
Surprised 5.9%
Sad 4.6%
Confused 4.5%
Disgusted 4.4%
Angry 4.1%
Fear 1%

AWS Rekognition

Age 43-51
Gender Male, 99.9%
Happy 64.4%
Surprised 21%
Fear 11%
Confused 1.2%
Sad 1.2%
Angry 0.5%
Disgusted 0.5%
Calm 0.3%

AWS Rekognition

Age 54-62
Gender Male, 80.1%
Surprised 37.4%
Happy 26.8%
Calm 25.1%
Confused 4%
Sad 2%
Disgusted 2%
Angry 1.7%
Fear 0.9%

AWS Rekognition

Age 23-33
Gender Male, 97.7%
Sad 68.7%
Calm 19%
Disgusted 7%
Fear 2.5%
Happy 1.4%
Angry 0.6%
Surprised 0.4%
Confused 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 98.6%
Person 98.3%
Suit 78.2%

Captions

Microsoft

a group of people posing for a photo 98%
a group of people standing in front of a mirror posing for the camera 92.4%
a group of people posing for the camera 92.3%

Text analysis

Amazon

8
KODVK-VEETA

Google

KODVK 2VEELA
2VEELA
KODVK