Human Generated Data

Title

Untitled (man receiving award)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20056

Human Generated Data

Title

Untitled (man receiving award)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Human 97.6
Person 97.4
Person 97.3
Apparel 94.4
Clothing 94.4
Sunglasses 94.2
Accessories 94.2
Accessory 94.2
Tie 90.6
Meal 78.4
Food 78.4
Plant 72.2
Shirt 72
Blossom 65.5
Flower 65.5
Coat 58.3
Waiter 57.9
Chef 57.4
Sleeve 56.8
Long Sleeve 56.8
Flower Arrangement 56.8
Cream 55.4
Cake 55.4
Creme 55.4
Icing 55.4
Dessert 55.4
Dish 55.1

Imagga
created on 2022-03-05

lab coat 47.1
man 43
coat 41.1
male 39
people 34
person 33.3
professional 28.7
adult 25.8
businessman 25.6
worker 24.7
business 24.3
waiter 24
happy 23.8
nurse 23.7
smiling 22.4
job 22.1
medical 22.1
office 20.9
men 20.6
doctor 19.7
dining-room attendant 19.3
patient 18.9
indoors 18.4
working 17.7
work 17.3
garment 17.2
corporate 17.2
employee 16.8
sitting 16.3
team 16.1
lifestyle 15.9
hospital 15.7
day 15.7
colleagues 15.5
portrait 15.5
clothing 15.3
women 15
smile 15
casual 14.4
attractive 14
suit 13.7
health 13.2
clinic 13.1
teamwork 13
group 12.9
30s 12.5
businesspeople 12.3
meeting 12.2
occupation 11.9
businesswoman 11.8
happiness 11.8
color 11.7
bright 11.4
desk 11.3
couple 11.3
senior 11.2
computer 11.2
mature 11.2
laptop 10.9
black 10.8
coworkers 10.8
scientist 10.8
lab 10.7
hairdresser 10.6
chemistry 10.6
laboratory 10.6
medicine 10.6
profession 10.5
talking 10.5
career 10.4
looking 10.4
home 10.4
room 10.3
executive 10.2
indoor 10
student 10
care 9.9
associates 9.8
modern 9.8
40s 9.7
assistant 9.7
chemical 9.7
standing 9.6
two 9.3
handsome 8.9
technology 8.9
success 8.8
mid adult 8.7
education 8.7
table 8.7
research 8.6
ethnic 8.6
biology 8.5
adults 8.5
pretty 8.4
study 8.4
hand 8.4
life 8.3
teacher 8.3
20s 8.2
successful 8.2
cheerful 8.1
brunette 7.8
50s 7.8
businessmen 7.8
scientific 7.8
concentration 7.7
horizontal 7.5
focus 7.4
inside 7.4
practitioner 7.2
kitchen 7.2
family 7.1
face 7.1
to 7.1
together 7

Google
created on 2022-03-05

Microsoft
created on 2022-03-05

text 94.5
person 92.9
man 91.5
clothing 88
black and white 80.5

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 96.7%
Happy 83.6%
Calm 11.9%
Surprised 1.4%
Fear 1%
Confused 0.8%
Disgusted 0.6%
Sad 0.4%
Angry 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.4%
Sunglasses 94.2%
Tie 90.6%

Captions

Microsoft

a group of people standing in front of a window 89.6%
a group of men standing in front of a window 86.4%
a man and a woman standing in front of a window 74%

Text analysis

Amazon

AGAIN
AND
CINDE
AND AGAIN W-WITH
ACT
W-WITH

Google

CINDE AND AGAIN WIT
AND
AGAIN
CINDE
WIT