Human Generated Data

Title

Irving Berlin (1888-1989) and Ellin Mackay Berlin and children [for Condé Nast]

Date

c. 1930

People

Artist: Edward Steichen, American 1879 - 1973

Sitter: Irving Berlin,

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Bequest of Edward Steichen by direction of Joanna T. Steichen and the George Eastman House, P1982.16

Copyright

© The Estate of Edward Steichen / Artists Rights Society (ARS), New York

Human Generated Data

Title

Irving Berlin (1888-1989) and Ellin Mackay Berlin and children [for Condé Nast]

People

Artist: Edward Steichen, American 1879 - 1973

Sitter: Irving Berlin,

Date

c. 1930

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 98.5
Human 98.5
Person 98.2
Person 97.8
Newborn 96.4
Baby 96.4
Person 95.5
Furniture 82.1
Painting 76.8
Art 76.8
People 74.5
Female 73.3
Indoors 72.5
Couch 69.9
Photo 61.8
Photography 61.8
Woman 59.6
Face 59.5
Room 59.2
Clothing 59.2
Apparel 59.2
Blanket 58.3
Girl 57.1
Shelf 55
Person 53.2

Imagga
created on 2021-12-15

mother 60.6
parent 54.9
kin 49.3
home 38.3
father 35.2
family 34.7
man 31.6
love 30
couple 29.6
happy 29.5
male 28.6
people 28.5
dad 27.7
child 27.1
adult 26.7
daughter 26.2
couch 25.1
smiling 24.6
happiness 23.5
together 22.8
husband 20.2
sitting 19.8
grandma 18.8
portrait 18.8
wife 18
loving 17.2
cheerful 17.1
room 16.4
person 16.3
sofa 16.3
groom 16.2
relationship 15.9
indoors 15.8
smile 14.3
women 14.2
kid 14.2
interior 14.2
senior 14.1
lifestyle 13.7
indoor 13.7
casual 13.6
dress 13.6
face 13.5
grandfather 13.4
holding 13.2
care 13.2
patient 13.2
children 12.8
attractive 12.6
old 12.6
married 12.5
elderly 12.5
baby 12.3
females 12.3
caring 11.8
son 11.7
bed 11.4
playing 10.9
aged 10.9
living room 10.8
fun 10.5
boy 10.4
adults 10.4
men 10.3
mature 10.2
day 10.2
two 10.2
wedding 10.1
house 10
fashion 9.8
pretty 9.8
parents 9.8
looking 9.6
bride 9.6
expression 9.4
cute 9.3
elegance 9.2
joy 9.2
girls 9.1
clothing 9.1
relaxing 9.1
human 9
life 9
childhood 9
parenthood 8.8
hug 8.7
affection 8.7
30s 8.7
domestic 8.6
comfortable 8.6
20s 8.3
romance 8
hair 7.9
bonding 7.8
affectionate 7.7
living 7.6
chair 7.6
laughing 7.6
togetherness 7.6
celebration 7.2
model 7

Google
created on 2021-12-15

Microsoft
created on 2021-12-15

person 99.9
sitting 98.7
toddler 97.2
human face 96.7
text 96.1
clothing 95.6
child 75.2
woman 69.6
black 65.7
smile 56.3
baby 55.5
crowd 0.8

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 29-45
Gender Female, 50.5%
Calm 60.2%
Sad 37.2%
Angry 1%
Confused 0.9%
Surprised 0.3%
Happy 0.3%
Fear 0.1%
Disgusted 0%

AWS Rekognition

Age 23-35
Gender Male, 99.4%
Sad 93.3%
Calm 5.5%
Confused 0.4%
Angry 0.4%
Fear 0.2%
Happy 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 19-31
Gender Female, 96.2%
Calm 74%
Sad 14.7%
Disgusted 3.9%
Fear 2.7%
Surprised 2%
Happy 1.7%
Confused 0.7%
Angry 0.3%

AWS Rekognition

Age 0-3
Gender Female, 97.6%
Calm 98%
Happy 1.4%
Sad 0.3%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Angry 0%
Disgusted 0%

Microsoft Cognitive Services

Age 0
Gender Female

Microsoft Cognitive Services

Age 4
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Painting 76.8%

Captions

Microsoft

a group of young men sitting next to a baby 61.8%
a group of men sitting next to a baby 61.7%
a group of people sitting next to a baby 61.6%

Text analysis

Amazon

NAST
CONDE'
1225-15
COPYRIGHT
PUB.
COPYRIGHT QY"THE CONDE' NAST PUB. ine
VOCUE
QY"THE
ine

Google

RIGHT
ON"
Ine
VEELA-KODN
5-
NAST
CODY
THE
CONDE.'
PUR,
12Z
12Z 5- (S CODY RIGHT ON" THE CONDE.' NAST PUR, Ine VEELA-KODN
(S