Human Generated Data

Title

Untitled (young boy posing with arms around his sister wearing pajamas in living room)
Date

1940-1955
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9056

Human Generated Data

Title

Untitled (young boy posing with arms around his sister wearing pajamas in living room)

People

Artist: Martin Schweig, American 20th century

Date

1940-1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Indoors 98.4
Room 98.4
Living Room 98.4
Human 97.8
Person 97.8
Table Lamp 95.2
Lamp 95.2
Furniture 95.1
Interior Design 92.6
Person 76.9
Plant 70.7
Couch 69.1
Tree 63.5
Bedroom 57.3
Home Decor 56.8
Bed 56.6
Lobby 56.4
Photography 55.6
Photo 55.6
Face 55.6
Portrait 55.6
Table 55

Imagga
created on 2022-01-23

child 29.1
interior 24.7
home 24.7
person 22.3
room 20.5
adult 20.4
people 20.1
happiness 18.8
happy 18.8
house 18.4
portrait 18.1
smiling 18.1
cute 17.9
smile 17.1
mother 16.8
looking 16.8
girls 16.4
face 16.3
indoor 15.5
man 15.4
cheerful 15.4
pretty 15.4
lifestyle 15.2
indoors 14.9
casual 14.4
fashion 14.3
family 14.2
women 14.2
kid 14.2
one 13.4
parent 13.3
little 13.2
window 13
lady 13
sitting 12.9
human 12.7
fun 12.7
two 12.7
hair 12.7
childhood 12.5
blond 12
children 11.8
joy 11.7
sexy 11.2
style 11.1
male 10.6
life 10.3
luxury 10.3
inside 10.1
domestic 10
light 10
holding 9.9
case 9.2
attractive 9.1
old 9.1
dress 9
black 9
furniture 9
together 8.8
standing 8.7
love 8.7
chair 8.6
grandfather 8.2
alone 8.2
playing 8.2
retro 8.2
shop 8.1
model 7.8
modern 7.7
youth 7.7
school 7.6
clothing 7.5
leisure 7.5
vintage 7.4
floor 7.4
shopping 7.3
decoration 7.2
bright 7.1
bathroom 7.1
architecture 7
look 7

Google
created on 2022-01-23

Black 89.5
Picture frame 88.3
Building 86.1
Interior design 84.4
Grey 84.2
Black-and-white 84.1
Style 83.9
Font 82.5
Curtain 81.4
Shelf 75
Monochrome photography 73.5
Monochrome 72.7
House 72.5
Art 72.1
Living room 71.3
Rectangle 71
Room 70.8
Television set 65.4
Chair 64.3
Stock photography 63.9

Microsoft
created on 2022-01-23

text 96.1
furniture 80
black and white 79.5
vase 75.3
room 62.6
chair 50.3

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Male, 97.7%
Calm 58.7%
Sad 20.8%
Happy 14%
Angry 3.3%
Surprised 1.1%
Disgusted 0.8%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 37-45
Gender Male, 99.7%
Surprised 50.5%
Calm 30.6%
Happy 6.4%
Sad 4.3%
Angry 2.7%
Fear 2.7%
Confused 1.7%
Disgusted 1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.8%

Captions

Microsoft

a person standing in front of a window 70.8%
a person sitting in front of a window 65.3%
a person sitting in a room 65.2%

Text analysis

Amazon

MJ17--YT37A- -

Google

MJI7--YT
MJI7--YT 3RA°2--AGOX
3RA°2--AGOX