Human Generated Data

Title

G. Family (Pastors), Cottbus

Date

1982

People

Artist: Christian Borchert, German 1942 - 2000

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 2018.217

Copyright

© Estate of Christian Borchert

Human Generated Data

Title

G. Family (Pastors), Cottbus

People

Artist: Christian Borchert, German 1942 - 2000

Date

1982

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Furniture 99.5
Person 99.3
Human 99.3
Person 99.2
Sitting 98.4
Couch 97.4
Person 96.1
Indoors 95.9
Living Room 95.9
Room 95.9
Chair 95.1
Plant 92.3
Table 92.2
People 87.1
Pottery 80
Vase 80
Jar 80
Food 79.9
Meal 79.9
Flower 75.6
Blossom 75.6
Art 71.6
Flower Arrangement 71.6
Ikebana 71.6
Ornament 71.6
Female 70.1
Tree 66.5
Clothing 65.5
Apparel 65.5
Dish 65.1
Potted Plant 64
Dining Room 63.5
Skin 59.9
Face 59.3
Coffee Table 58.4
Photography 57.7
Photo 57.7
Family 57.1
Dining Table 56.5
Eating 55.7

Clarifai
created on 2019-07-20

people 99.8
furniture 99.3
child 98.7
adult 98.5
room 98.3
two 97
seat 96.8
family 96.1
sit 95.7
chair 95.4
indoors 94.6
group 94.4
man 94
woman 93.7
one 93.7
son 93
three 92.3
wear 91.3
offspring 90.8
boy 89.8

Imagga
created on 2019-07-20

home 42.3
couple 31.3
sitting 30.9
kin 29.4
adult 28.1
room 28
family 26.7
happy 26.3
people 25.6
man 25.5
indoors 25.5
mother 25
couch 24.1
person 23.6
smiling 23.1
together 22.8
lifestyle 22.4
sofa 22.2
smile 20.7
cheerful 20.3
male 20.2
chair 19.4
relaxing 18.2
living 18
child 17.5
women 17.4
happiness 17.2
casual 16.9
portrait 16.8
interior 16.8
daughter 16.7
father 16.5
indoor 16.4
30s 16.3
house 16
domestic 15.3
love 15
attractive 14.7
table 14.4
grandfather 14.4
adults 14.2
day 14.1
men 12.9
looking 12.8
mid adult 12.5
dad 12.2
20s 11.9
cup 11.7
drink 11.7
seat 11.6
clothing 11.6
husband 11.4
group 11.3
fun 11.2
coffee 11.1
children 10.9
living room 10.8
parent 10.6
comfortable 10.5
computer 10.5
reading 10.5
laughing 10.4
friends 10.3
relaxed 10.3
relaxation 10
beverage 9.9
boy 9.6
loving 9.5
wife 9.5
enjoying 9.5
color 9.5
togetherness 9.4
son 9.3
bright 9.3
furniture 9.2
face 9.2
business 9.1
armchair 8.9
elementary age 8.9
brown hair 8.8
40s 8.8
elderly 8.6
talking 8.5
two 8.5
senior 8.4
eating 8.4
pretty 8.4
mature 8.4
laptop 8.3
camera 8.3
leisure 8.3
fashion 8.3
inside 8.3
book 8.2
work 8.1
food 8
brother 7.9
beverages 7.8
couples 7.8
emotions 7.8
drinking 7.7
resting 7.6
restaurant 7.6
females 7.6
sit 7.6
enjoyment 7.5
sibling 7.4
emotion 7.4
dinner 7.2
blond 7.2
cute 7.2

Google
created on 2019-07-20

Photograph 95.3
People 94.7
Room 87
Furniture 79.2
Sitting 78
Table 71.7
Black-and-white 68.3
Chair 66.2
Monochrome 64.3
House 63.1
Photography 62.4
Interior design 59.1
History 54.1
Family 51.8
Gentleman 51.3

Microsoft
created on 2019-07-20

table 95.4
furniture 95.4
person 95.1
clothing 92.5
indoor 90.1
black and white 89.3
chair 75.4
family 73.6
human face 71.5
smile 69.9
seat 37.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.7%
Angry 6.2%
Sad 4.9%
Happy 5.4%
Disgusted 6.2%
Surprised 1.3%
Confused 5.5%
Calm 70.5%

AWS Rekognition

Age 20-38
Gender Female, 99.5%
Happy 1%
Calm 80.1%
Sad 3.4%
Angry 1.8%
Disgusted 10.9%
Surprised 2.3%
Confused 0.5%

AWS Rekognition

Age 4-9
Gender Female, 79.6%
Disgusted 1.3%
Happy 3.3%
Calm 68.6%
Angry 4.8%
Confused 6.5%
Sad 3.5%
Surprised 12%

AWS Rekognition

Age 23-38
Gender Female, 55%
Surprised 45.3%
Angry 47%
Happy 46.2%
Disgusted 45.4%
Sad 49.9%
Confused 45.3%
Calm 45.9%

Microsoft Cognitive Services

Age 3
Gender Female

Microsoft Cognitive Services

Age 7
Gender Male

Microsoft Cognitive Services

Age 44
Gender Male

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Chair 95.1%
Dining Table 56.5%

Captions

Microsoft

a man and a woman sitting on a table 54.8%
a man and a woman sitting on a bed 49.9%
a person sitting at a table with a cake 49.8%