Human Generated Data

Title

Untitled (parents posed seated with young girl and boy standing in corner of room)
Date

1943
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9045

Human Generated Data

Title

Untitled (parents posed seated with young girl and boy standing in corner of room)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Apparel 99.8
Clothing 99.8
Person 98.7
Human 98.7
Person 98
Person 97.7
Person 97.5
Sleeve 91.3
Long Sleeve 83.2
Furniture 78.6
Chair 78.6
Female 77
Coat 76.5
Shirt 73.8
Face 73.2
Girl 66.2
Door 65.7
Kid 64.7
Child 64.7
Portrait 64.1
Photography 64.1
Photo 64.1
Suit 60.4
Overcoat 60.4
Shorts 57.6
Lab Coat 56.7
Indoors 56.2

Imagga
created on 2022-01-23

lab coat 57.4
coat 51.3
man 44.4
nurse 42.6
surgeon 41.7
person 41.5
doctor 41.4
medical 38
patient 37.2
male 36.9
people 34.6
hospital 32.6
professional 32.1
specialist 29.3
adult 27.6
medicine 26.4
team 26
senior 24.4
health 24.3
smiling 21.7
looking 21.6
clinic 21.3
happy 21.3
businessman 21.2
business 20.7
stethoscope 20.4
portrait 20.1
case 19.8
job 19.5
indoors 19.3
care 18.9
work 18.8
mature 18.6
teamwork 18.5
elderly 18.2
men 18
group 17.7
garment 17.6
uniform 17.4
30s 17.3
sick person 17.1
worker 17
staff 16.3
clothing 16
smile 15.7
standing 15.6
occupation 14.7
colleagues 14.6
women 14.2
working 14.1
student 14
camera 13.9
doctors 13.8
lifestyle 13.7
laboratory 13.5
profession 13.4
couple 13.1
office 12.9
indoor 12.8
mid adult 12.5
handsome 12.5
20s 11.9
friendly 11.9
two 11.9
confident 11.8
happiness 11.8
thirties 11.7
lab 11.7
expertise 11.6
serious 11.4
businesspeople 11.4
technology 11.1
bright 10.7
middle aged 10.7
assistant 10.7
science 10.7
color 10.6
exam 10.5
home 10.4
meeting 10.4
teacher 10.3
casual 10.2
face 9.9
clinical 9.8
physician 9.8
cheerful 9.8
human 9.8
consultant 9.7
illness 9.5
research 9.5
inside 9.2
successful 9.2
attractive 9.1
businesswoman 9.1
holding 9.1
old 9.1
suit 9
coworkers 8.8
50s 8.8
40s 8.8
look 8.8
scientific 8.7
chemistry 8.7
busy 8.7
test 8.7
education 8.7
corporate 8.6
sitting 8.6
desk 8.5
black 8.4
company 8.4
explaining 7.9
fifties 7.9
associates 7.9
scientist 7.8
two people 7.8
examination 7.8
older 7.8
chemical 7.7
looking camera 7.7
chart 7.6
executive 7.6
equipment 7.6
females 7.6
treatment 7.3
success 7.2
computer 7.2
to 7.1
day 7.1
together 7

Google
created on 2022-01-23

Smile 95.9
Sleeve 87.2
Gesture 85.3
Style 83.9
Black-and-white 83.7
Monochrome photography 74
Font 73.4
T-shirt 73.1
Monochrome 69.1
Art 68.9
Team 67.3
Room 67
Event 66
Uniform 65.9
Eyewear 65.7
Stock photography 63.4
Shorts 61.3
Vintage clothing 58.5
Photo caption 57.6
Photographic paper 53.2

Microsoft
created on 2022-01-23

wall 98.6
smile 97.4
text 97.1
person 93.4
clothing 91.8
human face 91.3
man 83.1
posing 78
woman 71.4

Face analysis

Amazon

Google

AWS Rekognition

Age 25-35
Gender Male, 99.5%
Happy 74.8%
Calm 18.6%
Surprised 4.5%
Disgusted 0.8%
Sad 0.6%
Angry 0.3%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 26-36
Gender Male, 97.8%
Surprised 56.2%
Calm 39.4%
Happy 3.1%
Disgusted 0.5%
Confused 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 25-35
Gender Female, 94.5%
Surprised 67.7%
Calm 19.9%
Happy 8.6%
Confused 1.3%
Fear 1%
Disgusted 0.9%
Angry 0.3%
Sad 0.3%

AWS Rekognition

Age 29-39
Gender Female, 50.6%
Happy 76.1%
Surprised 11.3%
Calm 6.9%
Fear 2%
Sad 1.8%
Angry 0.8%
Disgusted 0.7%
Confused 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.7%

Captions

Microsoft

a group of people posing for a photo 92.7%
a group of men posing for a photo 91.3%
a group of people standing in front of a mirror posing for the camera 80.5%

Text analysis

Amazon

32A0
YT3RAS
32A0 YT3RAS A30W3330
A30W3330

Google

YT3RA2
32A0 YT3RA2 R3OM3330
32A0
R3OM3330