Human Generated Data

Title

Untitled (two boys with candle, rosary and bible for first communion)

Date

1955

People

Artist: John Deusing, American active 1940s

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1709

Human Generated Data

Title

Untitled (two boys with candle, rosary and bible for first communion)

People

Artist: John Deusing, American active 1940s

Date

1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Clothing 98.3
Apparel 98.3
Human 98.2
Person 98.2
Person 95.8
Home Decor 80.8
Glass 79.1
Sleeve 74.3
Flower 61.5
Plant 61.5
Blossom 61.5
Long Sleeve 60.5
Photography 60.2
Photo 60.2
Waiter 58.1
Goblet 55.6

Imagga
created on 2021-12-14

doctor 54.5
medical 48.5
coat 44.4
baron 43
professional 40.4
hospital 38.5
person 37.7
man 37
medicine 36.1
male 32.6
clinic 32.6
health 31.3
people 30.7
lab coat 30.3
stethoscope 30
adult 28.9
care 28
job 27.4
uniform 27.1
happy 26.9
laboratory 26
portrait 24.6
looking 24
occupation 23.8
confident 23.7
work 23.5
clinical 21.5
worker 21.2
business 20
mature 19.5
smile 18.5
smiling 18.1
practitioner 17.7
nurse 17.2
office 16.9
specialist 16.8
indoor 16.4
men 16.3
profession 16.3
working 15.9
doctors 15.7
attractive 15.4
handsome 15.2
senior 15
human 15
indoors 14.9
physician 14.6
elderly 14.4
face 14.2
businessman 14.1
employee 13.2
clothing 13.1
standing 13
successful 12.8
consultant 12.7
healing 12.6
lab 12.6
color 12.2
bright 12.2
one 11.9
friendly 11.9
casual 11.9
general practitioner 11.8
heal 11.8
examination 11.7
team 11.6
holding 11.6
chemical 11.5
research 11.4
corporate 11.2
technology 11.1
day 11
happiness 11
student 10.9
surgeon 10.8
expertise 10.7
vodka 10.6
chemistry 10.6
exam 10.5
staff 10.5
instrument 10.4
camera 10.2
suit 10.1
lifestyle 10.1
treatment 10.1
healthy 10.1
patient 10.1
hand 9.9
science 9.8
cheerful 9.8
assistant 9.7
success 9.7
30s 9.6
computer 9.6
waiter 9.5
biology 9.5
career 9.5
garment 9.5
teamwork 9.3
glasses 9.3
laptop 9.1
old 9.1
family 8.9
clinician 8.9
expert 8.9
general 8.8
good mood 8.8
scientist 8.8
diagnosis 8.8
medication 8.8
colleagues 8.7
1 8.7
busy 8.7
only 8.6
businesspeople 8.5
desk 8.5
black 8.4
modern 8.4
20s 8.2
clipboard 8.2
businesswoman 8.2
equipment 8.1
light 8
hair 7.9
women 7.9
associates 7.9
examining 7.8
brunette 7.8
50s 7.8
executive 7.8
older 7.8
health care 7.8
scientific 7.8
practice 7.7
mid adult 7.7
confidence 7.7
dining-room attendant 7.6
formal 7.6
illness 7.6
aged 7.2
mystic 7
look 7

Google
created on 2021-12-14

Smile 96.5
Sleeve 87.2
Standing 86.4
Gesture 85.3
Style 83.8
Black-and-white 82.4
Hat 82.3
Font 78.8
Curtain 75.4
Event 72.2
Plant 70.6
Fashion design 69
Drinkware 67.6
Monochrome photography 67.1
Formal wear 66.6
Monochrome 66.5
T-shirt 66.1
Uniform 65.5
Glass 62.4
Barware 61.8

Microsoft
created on 2021-12-14

wedding 90.7
text 89.1
vase 87.4
black and white 81
wine glass 73
posing 63
tableware 60
candle 59.1

Face analysis

Amazon

Google

AWS Rekognition

Age 21-33
Gender Male, 54.9%
Confused 74.4%
Calm 13.9%
Surprised 8.6%
Happy 2.1%
Sad 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 17-29
Gender Female, 62.6%
Calm 55.5%
Surprised 32.1%
Fear 6.6%
Happy 2.8%
Confused 1.1%
Sad 0.9%
Angry 0.8%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.2%

Captions

Microsoft

a group of people posing for a photo 85.2%
a person standing in front of a mirror posing for the camera 76.4%
a group of people posing for the camera 76.3%

Text analysis

Amazon

2
TOLIX
1050
- 2
-
25
4/21/1990
axy.o

Google

701
701