Human Generated Data

Title

Untitled (five men standing in front of painting)
Date

c. 1950
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20041

Human Generated Data

Title

Untitled (five men standing in front of painting)

People

Artist: Peter James Studio, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.7
Apparel 99.7
Human 98.3
Person 98.3
Person 96.8
Person 96.7
Person 96.2
Person 95.9
Sleeve 93.5
Long Sleeve 90.6
Coat 89.7
Overcoat 89.7
Person 83.6
Shirt 81.3
Accessory 73.1
Tie 73.1
Accessories 73.1
Suit 64.5
Face 63.8
Door 63.4
People 61.2
Tire 56.1
Tuxedo 55.5

Imagga
created on 2022-03-05

nurse 100
man 48.4
male 44.7
doctor 43.2
professional 40.6
people 38.5
medical 38
team 36.7
hospital 35.1
business 33.4
person 33.4
adult 31.5
businessman 30.9
happy 30.7
group 29.8
men 29.2
job 29.2
medicine 28.2
worker 27.4
portrait 26.5
colleagues 26.2
smiling 26
work 25.9
office 25.1
occupation 24.7
coat 24.4
standing 24.3
teamwork 24.1
confident 23.7
stethoscope 23.5
uniform 23.4
care 23
health 22.9
mature 22.3
clinic 22
smile 20.7
corporate 20.6
women 19.8
suit 18.9
handsome 18.7
looking 18.4
staff 18.4
practitioner 18.3
businesswoman 18.2
meeting 17.9
success 17.7
patient 17.7
doctors 16.7
indoors 16.7
30s 16.4
businesspeople 16.1
clinical 15.6
lab coat 15.5
working 15
successful 14.6
indoor 13.7
casual 13.6
diversity 13.5
confidence 13.4
profession 13.4
executive 13
40s 12.7
expertise 12.6
surgeon 12.6
lifestyle 12.3
building 12.1
specialist 11.9
friendly 11.9
workers 11.6
laboratory 11.6
partnership 11.5
bright 11.4
illness 11.4
cheerful 11.4
human 11.2
modern 11.2
attractive 11.2
camera 11.1
20s 11
associates 10.8
coworkers 10.8
consultant 10.7
mid adult 10.6
student 10.5
tie 10.4
desk 10.4
manager 10.2
black 10.2
color 10
face 9.9
diverse 9.8
businessmen 9.8
elderly 9.6
ethnic 9.5
career 9.5
day 9.4
senior 9.4
company 9.3
clothing 9.1
light 8.8
together 8.8
look 8.8
skill 8.7
talking 8.6
positive 8.3
healthy 8.2
lady 8.1
employee 7.9
expert 7.9
crew 7.9
good mood 7.8
thirties 7.8
examination 7.8
assistant 7.8
partners 7.8
room 7.8
partner 7.7
sick 7.7
four 7.7
formal 7.6
two 7.6
holding 7.4
inside 7.4
happiness 7.1

Google
created on 2022-03-05

White 92.2
Sleeve 87
Gesture 85.3
Style 84
Black-and-white 84
Collar 81.8
Font 79.8
Monochrome photography 74.5
Snapshot 74.3
Formal wear 74
Monochrome 73.6
Event 72.8
Fashion design 72.4
White-collar worker 70.1
Vintage clothing 69
Art 67.6
Team 67
Room 65.9
Stock photography 64.9
Uniform 64.1

Microsoft
created on 2022-03-05

clothing 97.9
wall 97.1
person 93.3
text 93
man 90.7
standing 77.3
black and white 64.9
footwear 59.3

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 25.6%
Sad 19.5%
Happy 16.9%
Confused 14.1%
Surprised 13.2%
Disgusted 4.5%
Angry 3.5%
Fear 2.6%

AWS Rekognition

Age 51-59
Gender Male, 99.7%
Calm 98.9%
Sad 0.4%
Happy 0.3%
Disgusted 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 50-58
Gender Male, 99.7%
Calm 48.1%
Surprised 36.6%
Happy 4.7%
Sad 3.2%
Confused 2%
Angry 1.9%
Fear 1.8%
Disgusted 1.7%

AWS Rekognition

Age 37-45
Gender Male, 98%
Calm 93.7%
Sad 5%
Surprised 0.5%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%
Tie 73.1%
Suit 64.5%

Captions

Microsoft

a group of people standing in front of a mirror posing for the camera 76%
a group of men standing in front of a mirror posing for the camera 70.1%
a man standing in front of a mirror posing for the camera 70%

Text analysis

Amazon

KODVK
CC
2VLE