Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Infants' Hospital: Infants
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.133

Human Generated Data

Title

Charity, Children: United States. New York. New York City. Randall's Island, Infants' Hospital: Infants

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-06-05

Art 93.6
Canvas 88.5
Human 78.8
Person 78.8
Person 78
Home Decor 77.1
Person 74.7
Painting 72
Person 67.5
Person 67.3
Art Gallery 62.3
Person 58.8
Person 57.2
Poster 56.4
Advertisement 56.4
Drawing 56.2
Modern Art 55.3

Clarifai
created on 2019-06-05

illustration 98.5
art 96
picture frame 94.1
no person 94
print 92.9
people 92.8
antique 91.4
vintage 91.2
indoors 90.9
old 90.8
desktop 90.5
business 89.9
retro 89.5
wall 89
window 89
house 88.9
family 88
inside 87.6
furniture 87
decoration 86

Imagga
created on 2019-06-05

old 23
paper 19.9
grunge 17
sketch 16.2
vintage 15.7
drawing 15.3
texture 14.6
blank 14.6
sconce 14.5
wall 13
frame 12.7
bracket 12.7
aged 12.7
design 12.5
retro 12.3
ancient 12.1
card 11.9
envelope 11.4
container 11.4
business 10.9
building 10.8
structure 10.5
architecture 10.4
support 10.3
symbol 10.1
decoration 9.9
representation 9.8
antique 9.7
stucco 9.7
object 9.5
empty 9.4
money 9.4
space 9.3
house 9.2
sign 9
black 9
device 9
board 8.9
art 8.8
ribbon 8.6
sculpture 8.6
gift 8.6
finance 8.4
banking 8.3
note 8.3
package 8.1
currency 8.1
chandelier 8
home 8
box 8
holiday 7.9
3d 7.7
travel 7.7
rusty 7.6
bill 7.6
investment 7.3
cash 7.3
wrapping 7.3
new 7.3
bank 7.3
present 7.3
insulating material 7.2
celebration 7.2

Google
created on 2019-06-05

Photograph 95.6
Picture frame 76.9
Painting 70.9
Room 65.7
Photography 62.4
Art 58.1
Illustration 50.4

Microsoft
created on 2019-06-05

room 98.8
scene 98
gallery 98
indoor 88.5
picture frame 81.1
painting 61.3
old 43
different 33.5
several 10.7

Face analysis

Amazon

AWS Rekognition

Age 4-7
Gender Female, 50.5%
Angry 49.5%
Disgusted 49.5%
Sad 50.4%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 50.4%
Sad 50.4%
Angry 49.5%
Disgusted 49.5%
Surprised 49.5%
Happy 49.5%
Calm 49.5%
Confused 49.5%

AWS Rekognition

Age 14-23
Gender Male, 54.6%
Calm 46.4%
Happy 47.1%
Confused 46.2%
Sad 47%
Angry 46.7%
Surprised 45.7%
Disgusted 45.9%

AWS Rekognition

Age 23-38
Gender Female, 50.5%
Angry 49.7%
Disgusted 49.5%
Sad 49.6%
Calm 49.9%
Happy 49.6%
Surprised 49.6%
Confused 49.6%

AWS Rekognition

Age 9-14
Gender Female, 50.4%
Angry 49.5%
Disgusted 49.5%
Calm 49.5%
Surprised 49.5%
Happy 49.6%
Sad 50.3%
Confused 49.5%

AWS Rekognition

Age 1-5
Gender Female, 54.5%
Surprised 45%
Angry 45.1%
Disgusted 45%
Happy 45%
Calm 45%
Sad 54.8%
Confused 45.1%

AWS Rekognition

Age 4-9
Gender Female, 50.3%
Sad 49.8%
Disgusted 49.6%
Calm 49.7%
Confused 49.5%
Angry 49.9%
Surprised 49.5%
Happy 49.5%

AWS Rekognition

Age 17-27
Gender Female, 50.4%
Sad 49.8%
Angry 49.6%
Happy 49.7%
Disgusted 49.5%
Calm 49.8%
Surprised 49.5%
Confused 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.3%
Surprised 49.5%
Sad 50.5%
Calm 49.5%
Happy 49.5%
Disgusted 49.5%
Confused 49.5%
Angry 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.5%
Calm 49.5%
Confused 49.5%
Happy 49.9%
Sad 50%
Disgusted 49.5%
Surprised 49.5%

AWS Rekognition

Age 6-13
Gender Female, 50.5%
Angry 49.5%
Calm 50%
Disgusted 49.5%
Happy 49.5%
Surprised 49.5%
Sad 49.9%
Confused 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.2%
Angry 45.6%
Confused 46%
Calm 48.2%
Surprised 45.5%
Sad 49.2%
Happy 45.4%
Disgusted 45.2%

AWS Rekognition

Age 4-7
Gender Female, 50.1%
Happy 45.1%
Surprised 45.1%
Angry 45.1%
Calm 45.4%
Sad 54.1%
Disgusted 45.1%
Confused 45.1%

AWS Rekognition

Age 17-27
Gender Female, 50.1%
Happy 49.5%
Disgusted 49.5%
Angry 49.6%
Confused 49.6%
Calm 49.8%
Surprised 49.7%
Sad 49.8%

AWS Rekognition

Age 20-38
Gender Female, 50.3%
Sad 50.2%
Angry 49.6%
Confused 49.6%
Happy 49.6%
Disgusted 49.5%
Surprised 49.5%
Calm 49.5%

AWS Rekognition

Age 2-5
Gender Female, 50.3%
Calm 49.5%
Happy 50%
Confused 49.5%
Sad 49.8%
Angry 49.5%
Surprised 49.6%
Disgusted 49.5%

AWS Rekognition

Age 20-38
Gender Female, 53.9%
Confused 45.5%
Disgusted 45.3%
Sad 47%
Surprised 46.9%
Calm 46%
Angry 46%
Happy 48.4%

AWS Rekognition

Age 20-38
Gender Male, 50%
Calm 49.7%
Confused 49.6%
Sad 49.8%
Surprised 49.6%
Happy 49.5%
Disgusted 49.6%
Angry 49.7%

AWS Rekognition

Age 30-47
Gender Female, 50.2%
Happy 49.6%
Sad 49.5%
Angry 49.5%
Surprised 49.6%
Calm 50.1%
Confused 49.7%
Disgusted 49.5%

Feature analysis

Amazon

Person 78.8%

Captions

Microsoft

a display in a room 71.1%
an old photo of a room 62.9%
an old photo of a person in a room 48.6%

Text analysis

Amazon

INFANTS

Google

INFANTS
INFANTS