Human Generated Data

Title

Untitled (man on couch with girl and baby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17654

Human Generated Data

Title

Untitled (man on couch with girl and baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17654

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 98.4
Human 98.4
Clothing 98
Apparel 98
Furniture 95.3
Person 93.2
Face 91.6
Couch 90.1
Baby 89.4
Chair 85.1
Bed 79.7
Indoors 75.8
Door 72.4
Portrait 71.9
Photography 71.9
Photo 71.9
Kid 71.7
Child 71.7
Tie 71.1
Accessories 71.1
Accessory 71.1
Housing 68.1
Building 68.1
Hat 66.9
Person 66.4
People 64.5
Play 59.2
Coat 58
Room 57.9
Living Room 57.6
Man 56.7
Female 56.5
Bedroom 56.1
Cushion 55.6
Smile 55.1
Person 47.8

Clarifai
created on 2023-10-29

people 99.9
child 99.6
two 98.5
adult 96
furniture 94.9
family 94.9
monochrome 94.7
three 94.5
woman 94.5
man 94.3
boy 94.3
group 93.8
room 93.6
indoors 93.1
son 92.8
four 89.2
offspring 88.4
sit 88.2
medical practitioner 86.9
wear 86.2

Imagga
created on 2022-02-26

patient 52
person 51.5
man 43
bobsled 34.6
sick person 34
case 33.3
male 31.2
sled 29.5
people 29.5
home 29.5
sitting 29.2
adult 28.1
vehicle 27.4
happy 26.3
room 25.6
men 18.9
work 18.8
together 18.4
laptop 18.2
professional 17.5
couple 17.4
casual 16.9
indoors 16.7
smile 16.4
team 16.1
women 15.8
smiling 15.2
nurse 15.2
happiness 14.9
house 14.2
senior 14
cheerful 13.8
conveyance 13.8
looking 13.6
portrait 13.6
worker 13.3
lifestyle 13
office 13
business 12.7
love 12.6
couch 12.6
health 12.5
family 12.4
job 12.4
working 12.4
bed 12.3
computer 12
modern 11.9
indoor 11.9
medical 11.5
table 11.3
human 11.2
equipment 11.1
leisure 10.8
hospital 10.8
sofa 10.6
medicine 10.6
living 10.4
relaxing 10
fun 9.7
interior 9.7
group 9.7
technology 9.6
reading 9.5
chair 9.4
meeting 9.4
two 9.3
communication 9.2
life 9.2
attractive 9.1
businessman 8.8
resting 8.6
uniform 8.5
relax 8.4
joy 8.3
teamwork 8.3
camera 8.3
joyful 8.3
holding 8.2
lady 8.1
handsome 8
specialist 7.9
living room 7.8
child 7.8
teacher 7.7
retirement 7.7
elderly 7.7
husband 7.6
illness 7.6
hand 7.6
executive 7.6
togetherness 7.5
doctor 7.5
tool 7.4

Google
created on 2022-02-26

Comfort 87.8
Style 83.8
Black-and-white 83.4
Smile 78
Monochrome 72.5
Monochrome photography 72.3
Curtain 70.4
Vintage clothing 69.9
Toddler 68.1
Sitting 67.6
Classic 66.5
Event 66.1
Room 65.2
Baby 64.5
Art 64
Motor vehicle 63.7
Stock photography 63.5
Photographic paper 54.8
Illustration 51.8
Child 51.7

Microsoft
created on 2022-02-26

sitting 95.3
person 85.8
clothing 85.5
human face 83.2
text 70.5
black and white 56.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 40-48
Gender Male, 100%
Calm 66.8%
Happy 22%
Surprised 10%
Disgusted 0.5%
Confused 0.3%
Angry 0.2%
Fear 0.2%
Sad 0.1%

AWS Rekognition

Age 42-50
Gender Male, 98.1%
Happy 90.2%
Surprised 9.2%
Calm 0.3%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%
Sad 0.1%
Confused 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Couch
Bed
Tie
Person 98.4%
Person 93.2%
Person 66.4%
Person 47.8%
Couch 90.1%
Bed 79.7%
Tie 71.1%

Captions

Microsoft
created on 2022-02-26

a person sitting on a bed 81.6%
a man and a woman sitting on a bed 66.1%
a man and woman sitting on a bed 59.4%

Text analysis

Amazon

MJI7
MJI7 YESTAD
YESTAD

Google

MJ17 YT37A2 A
MJ17
YT37A2
A