Human Generated Data

Title

Untitled (family portrait, parents and baby)
Date

1962
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16473

Human Generated Data

Title

Untitled (family portrait, parents and baby)

People

Artist: Lucian and Mary Brown, American

Date

1962

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16473

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.2
Human 99.2
Person 98.6
Clothing 98.6
Apparel 98.6
Person 97.4
Face 96.7
Baby 91.9
Sunglasses 91.7
Accessories 91.7
Accessory 91.7
Newborn 87.6
Suit 86.3
Overcoat 86.3
Coat 86.3
People 86.2
Female 78.1
Sleeve 76.9
Portrait 76.2
Photography 76.2
Photo 76.2
Sitting 73.2
Chair 72.1
Furniture 72.1
Couch 67.1
Man 67.1
Woman 65.6
Glasses 64.2
Shirt 61.3
Smile 60.5
Long Sleeve 58.9
Pants 56.3
Door 56

Clarifai
created on 2023-10-28

people 99.8
monochrome 99.2
man 99.1
portrait 98.7
adult 98.5
child 97.4
group 96.7
woman 96.3
baby 95
son 93
hospital 92.9
two 92.8
family 91.8
actor 91
ma 89.8
girl 89.5
medical practitioner 86.6
three 86.1
indoors 85.3
retro 82.9

Imagga
created on 2022-02-11

man 48.4
person 46.4
surgeon 41.5
people 38.5
male 36.2
specialist 34.8
adult 32.9
senior 31.9
medical 28.3
doctor 28.2
professional 28.1
businessman 27.4
patient 26.2
nurse 25.7
work 25.1
portrait 24.6
looking 24
elderly 23.9
worker 23.2
sitting 23.2
coat 22.7
human 21.7
men 21.5
happy 21.3
office 20.9
health 20.8
mature 20.5
working 19.4
table 19
old 18.8
smiling 18.8
couple 18.3
lab coat 18.1
business 17.6
indoors 17.6
occupation 17.4
hospital 17.3
suit 17.2
smile 17.1
handsome 16.9
illness 15.3
team 15.2
job 15
medicine 15
care 14.8
glasses 14.8
laboratory 14.5
clinic 14.4
home 14.4
desk 14.2
technology 14.1
lifestyle 13.7
computer 13.6
lab 13.6
together 13.1
teamwork 13
face 12.8
profession 12.4
equipment 12.4
husband 12.4
clothing 12.1
education 12.1
indoor 11.9
casual 11.9
room 11.8
laptop 11.8
older 11.7
retired 11.6
science 11.6
retirement 11.5
executive 11.5
research 11.4
hand 11.4
businesspeople 11.4
sick person 11.2
case 11
student 11
confident 10.9
colleagues 10.7
to 10.6
test 10.6
one 10.5
biology 10.4
meeting 10.4
women 10.3
stethoscope 10
chemical 9.9
holding 9.9
uniform 9.9
scientist 9.8
attractive 9.8
cheerful 9.8
chemistry 9.7
look 9.6
serious 9.5
development 9.5
wife 9.5
corporate 9.5
happiness 9.4
two 9.3
camera 9.2
modern 9.1
aged 9
color 8.9
researcher 8.9
chemist 8.9
success 8.9
biotechnology 8.8
middle aged 8.8
two people 8.8
assistant 8.7
expertise 8.7
scientific 8.7
hair 8.7
bright 8.6
tie 8.5
successful 8.2
instrument 8.2
lady 8.1
necktie 8.1
family 8
technician 7.8
surgery 7.8
40s 7.8
grandfather 7.7
sick 7.7
mid adult 7.7
busy 7.7
30s 7.7
boss 7.7
garment 7.5
pensioner 7.3
love 7.1

Google
created on 2022-02-11

Smile 95.9
Photograph 94.2
Black 89.5
Black-and-white 82.6
Snapshot 74.3
Art 71.9
Monochrome photography 71.1
Event 70.8
Vintage clothing 70.7
Monochrome 68.3
Suit 68.2
Happy 65.3
Tie 65.2
Stock photography 64.9
Sitting 63.4
Classic 62
Formal wear 61.7
Room 61.6
Font 60.3
Fun 57.7

Microsoft
created on 2022-02-11

wall 97.7
person 97.6
text 96.8
human face 94.7
clothing 93.6
man 87.2
posing 83.1
smile 61.3
fog 53.3
old 43

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 51.7%
Happy 99.5%
Calm 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Confused 0%
Fear 0%
Sad 0%

AWS Rekognition

Age 25-35
Gender Male, 62.2%
Surprised 93%
Happy 4.3%
Calm 1.1%
Sad 0.6%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.5%
Happy 97%
Surprised 1.5%
Calm 0.7%
Disgusted 0.2%
Confused 0.2%
Fear 0.2%
Sad 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses
Person 99.2%
Person 98.6%
Person 97.4%
Sunglasses 91.7%

Categories

Imagga

paintings art 99.7%

Text analysis

Amazon

BY
KODAK--1A-EITW

Google

MJI7--YT3RA°2--XAGON
MJI7--YT3RA°2--XAGON