Human Generated Data

Title

Untitled (little girl on bed with toys)
Date

February 1953, printed later
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.168

Human Generated Data

Title

Untitled (little girl on bed with toys)

People

Artist: Lucian and Mary Brown, American

Date

February 1953, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.168

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Furniture 99.8
Bedroom 99.6
Room 99.6
Indoors 99.6
Bed 96.4
Person 95
Human 95
Person 94.3
Interior Design 89.5
Dorm Room 73.1
Bird 71.6
Animal 71.6
Painting 66.2
Art 66.2
Couch 61.1
Person 58.6

Clarifai
created on 2023-10-26

people 99.9
child 99
room 97.5
three 97.3
adult 97.2
two 97.1
furniture 96.5
woman 96.2
group 95.9
medical practitioner 95.7
monochrome 95.5
group together 95.1
family 95
bed 93.5
ailment 93.4
four 93.1
boy 93.1
man 93.1
home 92.3
portrait 92.2

Imagga
created on 2022-01-23

barbershop 90.1
shop 69.4
mercantile establishment 54.2
room 37.3
place of business 36.6
man 29.6
home 26.3
people 25.6
indoors 25.5
hospital 23.8
male 22.7
patient 22.6
person 22.4
adult 21.4
interior 21.2
bed 21.1
establishment 18.5
bedroom 17.6
indoor 17.3
lifestyle 16.6
chair 16.1
men 15.5
comfortable 15.3
smiling 14.5
house 14.2
work 14.1
medical 14.1
health 13.2
happy 13.2
couple 13.1
office 13
inside 12.9
modern 12.6
sitting 12
women 11.9
happiness 11.7
relaxation 11.7
family 11.6
doctor 11.3
professional 11.1
casual 11
portrait 11
cheerful 10.6
illness 10.5
table 10.4
business 10.3
treatment 10.1
care 9.9
pillow 9.7
medicine 9.7
luxury 9.4
enjoyment 9.4
smile 9.3
face 9.2
horizontal 9.2
to 8.8
couch 8.7
furniture 8.7
resting 8.6
uniform 8.6
travel 8.4
holding 8.3
occupation 8.2
window 8.2
laptop 8.2
style 8.2
light 8
computer 8
love 7.9
architecture 7.8
two people 7.8
sick 7.7
stretcher 7.6
loving 7.6
lamp 7.6
talking 7.6
relax 7.6
lying 7.5
equipment 7.5
leisure 7.5
life 7.4
alone 7.3
worker 7.2
handsome 7.1
businessman 7.1

Google
created on 2022-01-23

Style 83.8
Motor vehicle 79.8
Adaptation 79.2
Picture frame 76.9
Monochrome photography 73.9
Art 73.8
Monochrome 72.9
Vintage clothing 71.4
Room 67.5
Event 65.2
Sitting 63.3
Classic 62.8
Stock photography 62.4
Table 61.9
Linens 61.7
Painting 61
History 59.9
Illustration 58.4
Photographic paper 58
Bed 55.1

Microsoft
created on 2022-01-23

drawing 96.3
sketch 90
text 84.8
person 77.4
clothing 76
black and white 62.7
room 42.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 1-7
Gender Male, 99.9%
Calm 61.3%
Surprised 23%
Confused 8.1%
Sad 3.8%
Happy 1.2%
Angry 1.1%
Disgusted 1%
Fear 0.5%

AWS Rekognition

Age 0-3
Gender Female, 100%
Surprised 69.7%
Fear 17.1%
Calm 9.1%
Sad 1.4%
Happy 0.8%
Confused 0.8%
Disgusted 0.6%
Angry 0.5%

Microsoft Cognitive Services

Age 2
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Bed 96.4%
Person 95%
Bird 71.6%
Painting 66.2%

Captions

Microsoft
created on 2022-01-23

a person sitting on a bed 59%
a person sleeping on a bed 40.1%
a group of men sitting on a bed 40%

Text analysis

Amazon

JAX
Dou-E-DoDow
Amata

Google

JAX Dou--DoD
JAX
Dou--DoD