Human Generated Data

Title

Untitled (family portrait)
Date

1938
People

Artist: Hamblin Studio, American active 1930s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2123

Human Generated Data

Title

Untitled (family portrait)

People

Artist: Hamblin Studio, American active 1930s

Date

1938

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2123

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.5
Human 99.5
Person 99.1
Person 97.9
Clothing 96.7
Apparel 96.7
People 96.3
Person 94.8
Person 93.8
Family 92.3
Suit 89
Overcoat 89
Coat 89
Tie 75.8
Accessories 75.8
Accessory 75.8
Shirt 64.9
Tuxedo 62.6
Face 56.9
Portrait 56.6
Photography 56.6
Photo 56.6

Clarifai
created on 2023-10-15

people 99.3
man 98.3
group 97.9
portrait 96.9
adult 95.3
uniform 93.5
doctor 92.2
three 90.8
hospital 90.6
monochrome 89.1
medical practitioner 85.1
woman 84.4
partnership 83.2
healthcare 81.1
scientist 80.6
care 79.2
two 78.9
coat 78.9
medical 77.4
medicine 76.3

Imagga
created on 2021-12-14

lab coat 93
coat 86
doctor 59.2
medical 52.1
man 50.4
professional 45
hospital 43.7
specialist 42.2
person 41.1
nurse 39
medicine 38.8
health 37.5
male 36.9
clinic 36.7
patient 35.7
adult 33.1
care 32.9
people 32.9
occupation 32.1
garment 31.7
stethoscope 31
job 28.3
mature 27.9
team 27.8
uniform 25.7
work 24.3
elderly 24
happy 23.8
practitioner 23.4
looking 23.2
worker 22.6
business 22.5
working 22.1
doctors 21.6
profession 21.1
clothing 21
senior 20.6
businessman 20.3
smiling 19.5
confident 19.1
portrait 18.8
clinical 18.6
office 18.5
teamwork 17.6
laboratory 17.4
handsome 16.9
colleagues 16.5
surgeon 16.3
illness 16.2
indoors 14.9
camera 14.8
physician 14.7
expertise 14.6
30s 14.4
exam 14.4
smile 14.3
treatment 13.8
men 13.7
indoor 13.7
businesspeople 13.3
couple 13.1
lifestyle 13
group 12.9
bright 12.9
color 12.8
face 12.8
40s 12.7
staff 12.4
human 12
casual 11.9
general practitioner 11.9
case 11.9
student 11.8
diagnosis 11.8
standing 11.3
attractive 11.2
old 11.2
sick person 11.1
women 11.1
healing 11
day 11
successful 11
happiness 11
consultant 10.7
examination 10.7
assistant 10.7
science 10.7
practice 10.7
sick 10.6
mid adult 10.6
research 10.5
technology 10.4
meeting 10.4
two 10.2
businesswoman 10
clinician 9.9
checkup 9.8
expert 9.8
heal 9.8
examining 9.8
good mood 9.8
lab 9.7
look 9.6
test 9.6
table 9.5
glasses 9.3
20s 9.2
friendly 9.2
black 9
associates 8.9
coworkers 8.8
50s 8.8
surgery 8.8
home 8.8
middle aged 8.8
ill 8.8
health care 8.7
busy 8.7
corporate 8.6
room 8.2
equipment 8.2
suit 8.1
success 8.1
fifties 7.9
discussing 7.9
scientist 7.8
visit 7.8
education 7.8
confidence 7.7
pharmacist 7.6
serious 7.6
talking 7.6
desk 7.6
healthy 7.6
horizontal 7.5
help 7.5
light 7.4
lady 7.3
aged 7.2
computer 7.2
modern 7

Google
created on 2021-12-14

Smile 96.5
White 92.2
Coat 90.2
Black 89.7
Hat 89.7
Black-and-white 84.5
Style 83.9
Headgear 80.9
Shorts 77
Monochrome 74.2
Monochrome photography 73.9
Event 70.7
Vintage clothing 70.7
Suit 70
Art 68.7
Formal wear 65.8
Stock photography 62.4
Uniform 62.1
Team 59.6
History 58.6

Microsoft
created on 2021-12-14

text 99.3
smile 97.9
person 95.4
clothing 95
human face 92.6
posing 86
ceremony 74.4
man 68.2
black 68.1
old 67.6
wedding 56.2

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-63
Gender Male, 98%
Surprised 48.6%
Happy 25%
Calm 20.1%
Confused 2.2%
Fear 2%
Angry 1.1%
Disgusted 0.6%
Sad 0.4%

AWS Rekognition

Age 48-66
Gender Male, 94.1%
Calm 94.5%
Sad 3.5%
Happy 1.1%
Confused 0.4%
Surprised 0.2%
Angry 0.2%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 29-45
Gender Female, 84.3%
Sad 96.4%
Calm 3%
Confused 0.3%
Fear 0.2%
Surprised 0.1%
Angry 0.1%
Happy 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Female, 58.7%
Happy 52.8%
Surprised 34.5%
Calm 10.2%
Confused 1.4%
Angry 0.4%
Sad 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 16-28
Gender Female, 72.7%
Calm 63.2%
Surprised 19.8%
Angry 6.3%
Happy 2.7%
Sad 2.6%
Fear 2.6%
Confused 1.9%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 75.8%

Categories

Imagga

paintings art 100%

Text analysis

Google

MAGON-YT39A2-1AMTEA
MAGON-YT39A2-1AMTEA