Human Generated Data

Title

Untitled (four men sitting in small office)
Date

c. 1950
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14320

Human Generated Data

Title

Untitled (four men sitting in small office)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Human 99.1
Person 99.1
Person 98.7
Person 98.1
Person 95.4
Sitting 89
Clothing 80.1
Apparel 80.1
Accessories 69.7
Accessory 69.7
Sunglasses 69.7
Furniture 67
Clinic 62.7
Tie 61.3
Photography 60.2
Face 60.2
Photo 60.2
Portrait 60.2
Chair 59.9
Senior Citizen 57.7
Handrail 56.6
Banister 56.6

Imagga
created on 2022-01-29

person 41.4
man 39
people 38.5
businessman 34.4
patient 30.2
male 29.8
business 28.5
adult 26.9
office 25.2
businesswoman 24.5
meeting 24.5
team 24.2
businesspeople 23.7
nurse 22.3
working 22.1
corporate 21.5
men 21.5
professional 20.3
teamwork 19.5
colleagues 19.4
happy 19.4
indoors 19.3
room 19
work 18.1
desk 18.1
smiling 18.1
worker 18
talking 17.1
group 16.9
job 16.8
women 16.6
sitting 16.3
executive 16.1
home 15.9
hospital 15.9
computer 15.2
together 14.9
30s 14.4
portrait 14.2
medical 14.1
doctor 14.1
manager 14
case 13.8
laptop 13.8
sick person 13.7
20s 13.7
health 13.2
successful 12.8
lifestyle 12.3
indoor 11.9
casual 11.9
suit 11.7
thirties 11.7
to 11.5
medicine 11.4
smile 11.4
table 11.3
clinic 11.2
modern 11.2
associates 10.8
mid adult 10.6
human 10.5
success 10.5
senior 10.3
color 10
coworkers 9.8
negative 9.6
clothing 9.6
illness 9.5
ethnic 9.5
teacher 9.5
occupation 9.2
confident 9.1
surgeon 9.1
new 8.9
collaboration 8.9
conference 8.8
40s 8.8
two people 8.7
cooperation 8.7
day 8.6
boss 8.6
formal 8.6
face 8.5
career 8.5
communication 8.4
presentation 8.4
instrument 8.4
lab coat 8.4
inside 8.3
planner 8.2
life 8.2
cheerful 8.1
business people 7.9
discussing 7.9
couple 7.8
happiness 7.8
education 7.8
film 7.7
laboratory 7.7
leader 7.7
coat 7.7
four 7.7
hand 7.6
adults 7.6
horizontal 7.5
company 7.4
mature 7.4
technology 7.4
specialist 7.4
hall 7.2
shop 7.2
bright 7.1
handsome 7.1
interior 7.1

Google
created on 2022-01-29

Black-and-white 83.5
Motor vehicle 82.8
Health care 81.6
Suit 79.2
Monochrome photography 73.5
Monochrome 72.6
Service 71.7
Event 70.7
Medical 69.9
Crew 68.5
White-collar worker 67.4
Room 66.1
Sitting 65.4
Curtain 62.5
Team 62.3
Uniform 61.8
Vintage clothing 60.6
Chair 53
Photo caption 52.1
Hospital 51.5

Microsoft
created on 2022-01-29

person 99.7
man 96.1
clothing 93.3
text 93.1
people 67.8
furniture 52.4

Face analysis

Amazon

Google

AWS Rekognition

Age 58-66
Gender Male, 99.7%
Calm 99.2%
Sad 0.4%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 48-56
Gender Male, 99.5%
Calm 94.8%
Confused 2.9%
Surprised 1%
Sad 0.5%
Disgusted 0.3%
Happy 0.3%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Sunglasses 69.7%
Tie 61.3%

Captions

Microsoft

a group of people standing around a table 95.2%
a group of people sitting at a table 92%
a group of people sitting around a table 91.9%

Text analysis

Amazon

MJIR
YT3302
MJIR YT3302 ARAA
ARAA

Google

MJ13
YT3302
MJ13 YT3302 A33A
A33A