Human Generated Data

Title

Charity, Children: Belgium. Louvain. Orphan Asylums: Public Charitable Institutions, Louvain, Belgium: Orphan Asylum for Girls.: Lunch.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.622.1

Human Generated Data

Title

Charity, Children: Belgium. Louvain. Orphan Asylums: Public Charitable Institutions, Louvain, Belgium: Orphan Asylum for Girls.: Lunch.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.622.1

Machine Generated Data

Tags

Amazon
created on 2019-06-07

Tablecloth 99.8
Person 96.6
Human 96.6
Person 96.2
Furniture 95.6
Person 90.6
Person 89
Table 87.8
Person 86.6
Person 86.1
Person 82.5
Person 79.3
Person 77.4
Person 74.7
Accessory 72.8
Accessories 72.8
Tie 72.8
Person 66.4
Person 65.7
Restaurant 61.7
Home Decor 61.2
Linen 61.2
Clinic 60.9
Dining Table 58.4
Person 50.2

Clarifai
created on 2019-06-07

people 100
group 99.5
many 99.1
leader 98.7
adult 98.6
administration 97.1
group together 97.1
furniture 95.9
man 95.5
print 95.2
chair 93.2
several 92.9
room 91.2
military 86.8
woman 86.4
war 84.1
wear 83.6
home 83.6
vehicle 81.5
sit 79.4

Imagga
created on 2019-06-07

blackboard 22.6
old 22.3
room 17.8
retro 17.2
people 15.6
vintage 15.1
person 14.5
art 14.3
man 14.1
wall 13.7
grunge 13.6
dirty 11.7
interior 11.5
antique 11.5
shop 11.4
home 11.2
design 10.7
decoration 10.5
classroom 10.3
brown 10.3
house 10
texture 9.7
business 9.7
pattern 9.6
male 9.3
aged 9
happy 8.8
paper 8.8
ancient 8.6
teacher 8.6
drawing 8.6
structure 8.6
architecture 8.6
box 8.5
black 8.4
building 8.4
rough 8.2
paint 8.1
border 8.1
family 8
holiday 7.9
color 7.8
portrait 7.8
travel 7.7
luxury 7.7
pretty 7.7
school 7.6
grungy 7.6
professional 7.6
frame 7.5
furniture 7.4
window 7.3
container 7.3
cheerful 7.3
indoor 7.3
lifestyle 7.2
women 7.1

Google
created on 2019-06-07

Photograph 95
Snapshot 85.5
Room 78
Table 63.8
Furniture 63.2
Vintage clothing 61.7
History 57.6

Microsoft
created on 2019-06-07

table 97.3
person 88.4
clothing 86.9
chair 69.6
old 64.5
white 60.7
room 41.1
furniture 20.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 14-25
Gender Female, 51.3%
Surprised 45.4%
Disgusted 46.2%
Angry 48.3%
Confused 45.2%
Calm 48%
Happy 45.3%
Sad 46.7%

AWS Rekognition

Age 10-15
Gender Female, 54.1%
Angry 45.4%
Sad 50.9%
Happy 46.4%
Surprised 45.5%
Disgusted 45.4%
Confused 45.2%
Calm 46.2%

AWS Rekognition

Age 35-52
Gender Female, 51.2%
Calm 46.2%
Disgusted 45.3%
Angry 45.7%
Sad 51.7%
Surprised 45.4%
Confused 45.4%
Happy 45.3%

AWS Rekognition

Age 19-36
Gender Female, 54.5%
Confused 45.2%
Disgusted 45.2%
Surprised 45.2%
Sad 51.7%
Happy 45.2%
Angry 45.7%
Calm 46.8%

AWS Rekognition

Age 29-45
Gender Female, 53.2%
Sad 53.2%
Surprised 45.3%
Disgusted 45.2%
Confused 45.4%
Happy 45.1%
Calm 45.5%
Angry 45.3%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 52.7%
Disgusted 45.4%
Angry 45.6%
Sad 45.8%
Surprised 45.2%
Confused 45.1%
Happy 45.1%

AWS Rekognition

Age 20-38
Gender Male, 50.2%
Sad 46.7%
Happy 45.2%
Angry 45.1%
Surprised 45.1%
Disgusted 45.1%
Confused 45.1%
Calm 52.7%

AWS Rekognition

Age 20-38
Gender Female, 55%
Surprised 45.6%
Sad 49.7%
Disgusted 45.9%
Calm 45.7%
Happy 46.9%
Angry 45.9%
Confused 45.3%

AWS Rekognition

Age 45-63
Gender Male, 52%
Surprised 45.2%
Confused 45.3%
Disgusted 45.8%
Angry 45.7%
Calm 52.2%
Happy 45.3%
Sad 45.5%

AWS Rekognition

Age 20-38
Gender Female, 54.2%
Confused 45%
Sad 54.8%
Angry 45.1%
Disgusted 45%
Happy 45%
Surprised 45%
Calm 45%

AWS Rekognition

Age 23-38
Gender Female, 50.4%
Sad 49.6%
Calm 50.2%
Angry 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.6%
Surprised 49.5%

AWS Rekognition

Age 26-43
Gender Female, 50.3%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%
Calm 49.6%
Sad 50.3%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 49.7%
Confused 49.5%
Disgusted 49.6%
Calm 49.8%
Happy 49.9%
Angry 49.5%
Surprised 49.5%

AWS Rekognition

Age 38-59
Gender Male, 52.3%
Disgusted 45.4%
Surprised 45.6%
Confused 45.6%
Sad 46.1%
Happy 45.4%
Calm 51%
Angry 45.8%

AWS Rekognition

Age 35-52
Gender Male, 54.4%
Angry 47.7%
Happy 45.1%
Disgusted 45.5%
Sad 48.6%
Confused 45.2%
Surprised 45.2%
Calm 47.7%

AWS Rekognition

Age 35-52
Gender Female, 50.3%
Calm 49.7%
Happy 49.5%
Surprised 49.5%
Disgusted 49.5%
Sad 50%
Angry 49.7%
Confused 49.5%

AWS Rekognition

Age 11-18
Gender Female, 50.4%
Calm 49.6%
Confused 49.6%
Happy 49.5%
Angry 49.6%
Surprised 49.5%
Disgusted 49.5%
Sad 50.1%

AWS Rekognition

Age 35-52
Gender Female, 50.1%
Disgusted 49.5%
Calm 49.9%
Confused 49.6%
Sad 49.9%
Angry 49.5%
Surprised 49.6%
Happy 49.6%

AWS Rekognition

Age 26-43
Gender Female, 50.5%
Angry 49.6%
Happy 49.7%
Confused 49.6%
Disgusted 49.6%
Sad 49.5%
Surprised 49.6%
Calm 49.8%

Microsoft Cognitive Services

Age 25
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Tie 72.8%

Categories

Imagga

interior objects 77.6%
paintings art 10.2%
streetview architecture 8.2%
food drinks 1.2%

Captions

Microsoft
created on 2019-06-07

a vintage photo of a person 70.5%
an old photo of a person 68%
a black and white photo of a person 58.1%