Human Generated Data

Title

Untitled (mixed race boy)

Date

c. 1854-1860

People

Artist: James Presley Ball, Sr., American 1825 - 1904

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.87

Human Generated Data

Title

Untitled (mixed race boy)

People

Artist: James Presley Ball, Sr., American 1825 - 1904

Date

c. 1854-1860

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.87

Machine Generated Data

Tags

Amazon
created on 2019-07-30

Human 99.3
Person 99.3
Clothing 98.5
Apparel 98.5
Art 98
Painting 98
Overcoat 77.4
Coat 77.4
Suit 77.4
Wood 67.8
Text 62.3
Photography 61.6
Photo 61.6
Accessory 55.7
Accessories 55.7
Tie 55.7
Shirt 55.5

Clarifai
created on 2019-07-30

art 98.6
people 97.9
picture frame 97.2
painting 96.3
one 95.8
retro 95.3
old 95.3
illustration 95
antique 94.9
vintage 94
wear 93.5
print 92.7
no person 92.1
adult 91.7
desktop 89.9
decoration 89.1
margin 89.1
portrait 86.9
gold 85.1
ornate 82.6

Imagga
created on 2019-07-30

amulet 45.6
old 44.6
vintage 39.7
antique 37.1
frame 36.3
charm 36.1
art 31.6
retro 31.2
ancient 26.8
gold 26.3
decoration 24.3
binding 22.8
ornate 21.1
design 20.8
blank 20.6
grunge 20.5
golden 19.8
texture 19.5
border 19
shield 18.5
paper 18.1
wall 18
empty 17.2
decorative 16.7
museum 16
aged 15.4
post 15.3
religion 15.3
interior 15.1
wood 15
symbol 14.8
postage 14.8
stamp 14.5
mail 14.4
pattern 14.4
history 14.3
style 14.1
armor 14.1
carved 13.7
culture 13.7
painting 13.6
letter 12.9
collection 12.6
architecture 12.6
rich 12.1
metal 12.1
classic 12.1
ornament 12.1
historic 11.9
protective covering 11.9
postmark 11.8
postal 11.8
object 11.7
rustic 11.5
framework 11.5
decor 11.5
money 11.1
brown 11.1
finance 11
device 10.9
wooden 10.6
ornamental 10.5
home 10.4
portrait 10.4
icon 10.3
elegance 10.1
mosaic 10
covering 10
currency 9.9
deco 9.8
paintings 9.8
frames 9.8
close 9.7
old fashioned 9.5
luxury 9.4
religious 9.4
face 9.2
cash 9.2
business 9.1
black 9
wealth 9
one 9
detail 8.9
baroque 8.8
textured 8.8
closeup 8.8
decorate 8.6
traditional 8.3
container 8.1
bank 8.1
gilded 7.9
gallery 7.9
envelope 7.8
royal 7.7
obsolete 7.7
clock 7.4
lighter 7.4
banking 7.4
time 7.3
dirty 7.2
carving 7.2
financial 7.1
photograph 7.1
travel 7

Google
created on 2019-07-30

Picture frame 96
Gentleman 87.5
Portrait 73.9
Antique 70.7
Art 67.7
Painting 57.1
Collection 57.1

Microsoft
created on 2019-07-30

person 97.9
clothing 96.8
human face 96.6
indoor 94.4
text 92.8
man 91
old 61.4
painting 22.2
picture frame 8.5

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 15-25
Gender Male, 70.2%
Angry 3.3%
Surprised 0.9%
Calm 5.7%
Happy 0.7%
Sad 84.2%
Disgusted 1.2%
Confused 4%

Microsoft Cognitive Services

Age 26
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Painting 98%

Categories

Imagga

paintings art 99.9%

Captions

Microsoft
created on 2019-07-30

a painting on the wall 77.3%
a painting on a wall 76.4%
a painting hanging on a wall 76.3%

Azure OpenAI

Created on 2024-01-27

This image features an individual dressed in vintage attire, characterized by a formal dark suit with a bowtie and a waistcoat. One can observe a glimpse of a white shirt and a handkerchief pocket. The person is seated with hands folded, and one hand appears to display a lightly colored object, possibly a piece of paper or a card. The photograph is set within an oval-shaped frame, which is richly detailed with ornate patterns, suggestive of a baroque or victorian style. The outer part of the frame is rectangular and seems to be made of weathered wood, contributing to the antique feel of the piece. The photograph itself shows signs of aging, with spots and marks scattered throughout. Encased in this textured and pattern-laden frame, the image exudes a sense of history, evoking a bygone era of portraiture.

Anthropic Claude

Created on 2024-03-29

The image shows a black-and-white portrait of a man in formal attire, likely taken during the mid-19th century based on the style of photography. The man is wearing a suit and bowtie, and has a serious expression on his face. The portrait is set within a decorative, gilded frame that adds to the formal and antique appearance of the image.

Text analysis

Amazon

oaoiowoOWWACWONGeaaora6o

Google

012
012