Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.
Date

c. 1900
People

Artist: Unidentified Artist,

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.235

Human Generated Data

Title

Crime, Children, Reform Schools: United States. New York. Freeville. George Junior Republic: George Junior Republic, Freeville, N.Y.

People

Artist: Unidentified Artist,

Date

c. 1900

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, Social Museum Collection, 3.2002.235

Machine Generated Data

Tags

Amazon
created on 2022-06-04

Person 99.1
Human 99.1
Person 99
Person 98.7
Person 98.3
Person 98.3
Person 98.2
Person 98
Person 97
Collage 96.9
Advertisement 96.9
Poster 96.9
Person 95.7
Person 94
Person 88.5
Art 82
Person 77.9
Text 71.6
Person 63.3
Portrait 59.9
Face 59.9
Photography 59.9
Photo 59.9

Imagga
created on 2022-06-04

envelope 100
container 74.5
paper 37.9
old 26.5
vintage 23.2
grunge 23
card 21.9
blank 21.4
design 21
note 19.3
frame 19.2
retro 18.9
page 18.6
antique 18.2
texture 18.1
money 17
message 16.4
letter 15.6
business 15.2
art 15
ancient 14.7
cash 14.6
notebook 14.4
currency 14.4
empty 13.7
gift 12.9
symbol 12.8
decorative 12.5
document 12.1
floral 11.9
finance 11.8
aged 11.8
border 11.8
drawing 11.7
cardboard 11.5
post 11.4
stamp 11.4
ribbon 11.1
brown 11
decoration 11
bank 10.8
creative 10.6
bill 10.5
dollar 10.2
greeting 10.2
flower 10
wallpaper 10
dirty 9.9
collection 9.9
board 9.7
pattern 9.6
artistic 9.6
graphic 9.5
leaf 9.3
present 9.1
financial 8.9
office 8.8
object 8.8
celebration 8.8
memory 8.7
holiday 8.6
damaged 8.6
season 8.6
space 8.5
banking 8.3
investment 8.3
text 7.9
album 7.8
reminder 7.8
notice 7.8
exchange 7.6
worn 7.6
sign 7.5
plant 7.5
birthday 7.4
artwork 7.3
decor 7.1
insulating material 7.1
textured 7

Google
created on 2022-06-04

Photograph 94.3
White 92.2
Art 83.5
Sleeve 83
Font 78.2
Tints and shades 75.1
Snapshot 74.3
Visual arts 69.5
Plant 68.7
Room 68.3
History 67.8
Stock photography 65.7
Paper product 64.8
Paper 64.3
Event 62.8
Collection 62.1
Rectangle 60.3
Vintage clothing 58.7
Collectable 58.3
Photography 52.8

Microsoft
created on 2022-06-04

gallery 100
room 100
scene 99.9
drawing 97.8
art 97.3
person 90
text 89.8
old 86.3
sketch 84.6
clothing 72.5
museum 63.2
man 60.1
posing 54.1
human face 52.3
picture frame 51.2
painting 45.9
vintage 28.4

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 6-14
Gender Female, 99.7%
Happy 99.9%
Surprised 6.3%
Fear 5.9%
Sad 2.2%
Disgusted 0%
Confused 0%
Angry 0%
Calm 0%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 85.3%
Sad 9.6%
Surprised 6.3%
Fear 6.1%
Angry 1.5%
Confused 0.9%
Disgusted 0.4%
Happy 0.3%

AWS Rekognition

Age 13-21
Gender Female, 100%
Sad 100%
Surprised 6.3%
Fear 6%
Calm 1.2%
Angry 1.1%
Confused 0.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 4-10
Gender Female, 98.1%
Calm 96.6%
Surprised 6.3%
Fear 6%
Sad 2.8%
Disgusted 0.4%
Angry 0.4%
Happy 0.2%
Confused 0.2%

AWS Rekognition

Age 16-22
Gender Female, 95.7%
Calm 96%
Surprised 6.3%
Fear 5.9%
Sad 3.4%
Angry 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%

AWS Rekognition

Age 2-8
Gender Female, 90%
Calm 70.4%
Sad 28.2%
Surprised 6.6%
Fear 6%
Disgusted 3.7%
Angry 2.5%
Confused 1.5%
Happy 0.7%

AWS Rekognition

Age 19-27
Gender Male, 99.7%
Calm 60.7%
Happy 23.5%
Surprised 6.6%
Sad 6.5%
Fear 6.2%
Confused 3%
Disgusted 2%
Angry 1.2%

AWS Rekognition

Age 26-36
Gender Male, 97.8%
Calm 95.7%
Surprised 6.4%
Fear 6%
Sad 2.3%
Angry 1.6%
Confused 1.4%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 79.8%
Happy 86.3%
Surprised 6.5%
Fear 6.2%
Confused 4.7%
Calm 4.4%
Sad 3.1%
Angry 0.3%
Disgusted 0.3%

AWS Rekognition

Age 0-6
Gender Female, 99.9%
Happy 73.3%
Calm 11.5%
Sad 8.7%
Surprised 6.6%
Fear 6.2%
Angry 1.6%
Confused 0.9%
Disgusted 0.9%

AWS Rekognition

Age 18-26
Gender Male, 90.6%
Happy 96.9%
Surprised 6.4%
Fear 5.9%
Sad 2.2%
Calm 1.6%
Confused 0.4%
Angry 0.2%
Disgusted 0.2%

AWS Rekognition

Age 25-35
Gender Female, 100%
Calm 64.1%
Sad 28.3%
Fear 12.4%
Surprised 6.6%
Happy 0.9%
Confused 0.7%
Disgusted 0.7%
Angry 0.6%

AWS Rekognition

Age 18-26
Gender Male, 79.3%
Angry 37.2%
Calm 30.4%
Sad 20.1%
Surprised 7.3%
Fear 7.2%
Disgusted 6.6%
Happy 2.7%
Confused 0.7%

AWS Rekognition

Age 33-41
Gender Male, 96.1%
Calm 81.1%
Surprised 7.8%
Confused 6.2%
Fear 6.2%
Sad 3.8%
Angry 2%
Disgusted 1.7%
Happy 1.3%

AWS Rekognition

Age 14-22
Gender Female, 73%
Sad 100%
Calm 15.3%
Surprised 6.3%
Fear 5.9%
Confused 1.3%
Angry 0.3%
Disgusted 0.2%
Happy 0.2%

Microsoft Cognitive Services

Age 55
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Categories

Imagga

paintings art 100%

Captions

Microsoft
created on 2022-06-04

a vintage photo of a painting 70.2%
a painting of a person 70.1%
an old photo of a painting 70%

Text analysis

Amazon

98178
G.g.13

Google

34185 98.13
34185
98.13